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ABSTRACT 

Conceived as an educational experiment designed to 
meet the unique needs of taigrant children. Training Migrant 
Paraprofessionals in Bilingual Mini Head Start is an early education 
prograja for children of migrant farm workers. Initiated in 1971, the 
ptogr^^in has two componpnts: th<^ *<Mobile Component*^ and the 
"Washington State Component." The "Mobile Component" provides service 
to children from the home base community of La Grulla, Texas, both in 
Texas and as the children move vith their families to northern states 
and back again. The "Washington State Component" provides year-round 
services at two stationary sites for both interstate and intrastate 
migrants or seasonal farm workers. Three key concepts developed by 
the program account for the difference in its success and the success 
of other models of mobile programs: (1) use of adult migrants as 
teachers, (2) use of a "mini'* center concept, and (3) application of 
"coordinated or supplementary services" concept • This evaluation 
report discusses the program* s progress during the 197^-75 program 
year# The outcome and process objectives are given along with a 
summary of fii^dings for the following components: instruction, staff 
development, parent and community involvement, materials development, 
and management for interstate delivery system. (HQ) 
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TRAINING MIGRANT PARAPROFESSIONALS IN BILINGUAL MINI HEAD 
START is an early education program for the children of migrant 
farm workers. 

It was funded in response to an invitation by the Division 
of Bilingual Education of the U.S. Office of Education for pro- 
jects proposing unique solutions to the special needs of children 
of migrant families. 

The project has two components. The "Mobile Canponent" " 
provides service to children from the home base community of 
La Grulla, Texas both in Texas and as the children move with their 
families to northern states and back again to Texas. The "Washing- 
ton State Component" provides year-round services at two stationary 
sites. These provide service to both interstate and intrastate 
migrants or seasonal farm workers. 

The program was initiated in 1971 and is now in its fourth 
year of operation. This evaluation represents the sixth in a 
series that have been published on this program. 

The grantee is the Intermediate School District 104, 
Ernest Forge, Superintendent, with offices at Ephrata, Washington. 

The project receives funds through the Texas Migrant Council 
for operation of the preschool portion of the interstate component. 
These funds are made available by the National Program Desk for 
Migrants and Indians in the Office of Child Development, Head 
Start Programs. 

The preschool programs which operate year-round in 
Washington State receive funds from the Division of Social and 
Health Services utilizing Title IVA of the Social Security Act. 

The school-age component, while it operates in Washington 
State, receives funds from*^the Office of the Superintendent of 
Public Instruction, URRD program. The program also utilizes funds 
provided by private agencies and donors. 



A NARRATIVE EVALUATIOH OF THL MOBILE COMPONEOT 



This program was conceived as an educational experiment 
designed to meet the unique needs of children whose parents are 
migrant farm worker s. One of the components of the program has 
been the "mobile" program. Children from a tiny community near 
the Rio Grande River in South Texas move every year with their 
families on a 6 r 000-mile journey to the north and back again to 
Texas. We undertook to send teachers with them, and provide edu- 
cational services on a year-round basis ^ The following narrative 
is offered as a perspective view— -where the program has come and 
where it is headed — in developing this unique service approach. 

GOAL: To Find An Effective Means of ?roviding 
Continuity in the Education of Children 
Who Move as Interstate Migrants. 



All programs for migrant children that serve them in only 
one location are limited in what they can accomplish by the short 
period of their service. Most feel that they have the children 
for so short a time it is not even worth attempting to measure 
educational gains. 

Even the combination of a series of programs a migrant 
child might attend as he moves from place to place are likely to 
add up to an unsatisfactory resiJJt. The child misses time from 
school in travel. He misses additional time in getting into the 
program at any new locations—time to get adjusted to new surround 
ings, people and methods, and time to, take placement tests, and 
find workbooks he can use. Perhaps the most damaging is the fact 
that each school is likely to be using different books and differ- 
ent methods, which may result in great cofifusion in the crucial 
first years of school when the child is just beginning to under- 
stand reading and math. 

^ All of these handicaps above mentioned made it worthwhile 
to try a mobile program. If successful in following the child 
from place to place, a mobile program could reach the child during 
a much longer period than one operating in just one location. If 
it utilized the same teachers and curriculum and methods, the 
adjustment time at each new stop could be much reduced. If he 
learned to read and do math by methods and using material that 
was the same in Texas as it was in the northern states, the con- 
fusion could be much less. All of these seemed like reasons that 
made it worth trying to manage a relocating interstate delivery 
system. » 

During 1969 and 1970 there was a flurry of demonstration 
programs tried, at the preschool level, to utilise a "mobile" con- 
cept in following children from place to place. These programs 
provided a model of a number of different things that do not work. 
One attempted by Southwest Educational Laboratory attempted to 
hire certified teaching staff to move with the children. There 
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Ho^oj bat^c fot' tht: nobiic program i U< U d ^ Tex-i?. 
CruXia" is th*j Sprjuxr.h u-m^i for m jig/f.^ to<-y bxrdi. ko the bjxd^: 
th'j town wac: n.i/o>-J, it-, inhjb. t.nt? lo^^'id up thv^^r home:- xn March 
un-i oppiru:'- xpi.>t")y '*0'' of tb»: l-y./f/ ..u.it)on n^ov, rtorth. Pj^.U 

He^^ d Start teacher-;, urc jdult;:. from famxlx'iei ah w»>i.ch 'vth^^r fi-i'.mbL 
Gtxil part of the mn^r^jnl v:>rK fcucu. TmzS'. t^.^jchcf- roovc too* t 
-mi to the northwest i.t^jt<'''c. of v.^^shinqton^ Or*. 9on, :^n^ Xd^ncu 



foe vhiCh 
or np^' I i 

r I r t- 

o Jll;^»Oii. 



1'?. >uch a :/nottH'e ot bxUngnrn, b^rultuc-O. , c^-rtvtied teacher?. 
tbJt obt.:an\ng 3?-^ch st.>ff in -iny corr^: tder 3b,l»? number would w 
]UTipoj:^::^ible, fx4d to this the disadvdintaqe of the -job--'the require- 
merit to mcfV»^ c^^eU and f'^mxly during the school ye^^r, to live xn 
areas in which housxrg was ey.t redely short bec3iu*?<e the miqr •:tnt^3 
used xt dU, and to work in temporary facxUties? with a variety 
of drawbacks, hoving to p.^^:?'^ and unpack teachin<'j m.^^itet ial s acid 
locate new suppliers in e^rch tempor»:ny ,^tr;p . 

In additxon tne Southw*-st t<jb prc-^r.-jjTj .jnd other (v.obtle 
proqra^ra funded by He^^d Start for migrants found a com;r-on probJ^.:m 
xn that mxgrants *ir. not move as large aroup, frorn c\ach location 
they scatter Ixke qu>3xi xn rn.jny dxfferent dirfctxons* A "center ' 
wxth jdiranistratxve and support staff stnd two or three teacherc. 
could only follow the largest nwiber , and wtien they moved main 
follow the largest n^imfcer ag^an. Each tme the service to the 
orxgirial group of children they had :?.tarted out wuh in Te:<a3 
would be less. They could do a-F. the Head Start p/cgr^aF*^^ did, ond 
recruxt new and dxf fere^^^^^ rragrant chxldren at each northern stop 
thereby providing sen/icec^ to mxqrarrt children, tut not to the 
same migrant children. Or they could do as the So^^thwe^st Lab 
MoBTle Prpgr/:Am did and ^^er^/e on)y the original group* but fewer 
and fewer [Children as the groun spUntered, ewntuaUy the 

ner\Mce a^oup w.^rr. almost exceeded by the staff. 
I 

ria greatest percentage of the tc^.-ji- ^^ome ba\-r chxldren 
whxch wer*^' ever picked up agaxn xn one or more legations xn north- 
ern statejs by the*iie other uen(oust« aixoo prcM^'ain^ was 1^'*. The 
fxr^^t year of operatxon of thxs progra^r., the Exlxngual I'xnx Head 
Start, the percentage of children successfully followed irom^ 
Te>:as through northern work locatxons and back to Te^vas vas 7:f>, 

There ar>a. three key concepts developed by thx5 program %>hxch 
account for the difference xn the succe*rr. of thxs. protjrairi ;wpd 
other models of mobile programs attempted xn the pd^st. 

ID Use of a dult ^'urji rants as teache rs. Our teacher-* ace 
adults recruited from families xn which otfer rAemt^ers are stv3l 
working in the migrant work force. They 3re w^ U mg to movc,^ :tnu 
h^ave housing where they move because grv.>>*eri? usually provide hcu3- 
xng or xt is provided xn the community for the tr.obxie migrant 
work force. Perhaps most important of all* they care deeply about 
tne children they are serving and have de^rronstr ated that they "^re , 
wxUxng to put up with many hard^^bxps and iticonvefii'onK:es tor the 
sake of the opportunxty the children wxll receive. 

^ ^- ^ nse of a "mx n i center conce p t , T he ^ x n x c e n t e r c c- n • 
cept refer?* to the idea oTH^^aving -j sxngte tedcher m >n isolate-rl 
location provxdxng service to frojr- sxk ';o ten children . Some of 
our teacher!:^' h-jve ended up work.xnq li^onc, with a few chxidren 
£ro*Tr the small group 'A farruUes who 'a:rve traveled together . 
Sometkme^c we use small v:^rrr cr, bus children togethe^r so ^-^on 
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ase of our teacher »^nd v;orke4 out released time for children 
to receive the su,upiejViJ-:rilaiy lessons during the school day, Tn 
''most CBses they h<^v;-:' a<:*^:d, in return, that we tutor additional 
children who they are not adequately reaching because of 
langaag[e barriers. Fepeate^jly, the suggestion has 'i^ome up that 
wc take .these referral children instead of the children we are 
following because the children in our program are often n\aking 
much better 
progress than 
others. We 
have r€-?sxsted 
this feeling 
that vj^e want 
to fully test 
th-J potential 
of following 
migrant chil-' 
dren through 
two or three 
early grades 
of school to 
sec what their 
full potenti-%1 
can be. 



Where 
xs it I'lac/ing? 
The pre 9 ram 
h3iS not yet 
reached the 
point where 
xt c:*n be 
cepl ica ted bv 
other a c e n exes 
Wc need rv^re 
ey p«^^ ^ cnco 
with the 
school •-o«-ic 
pr oa cari—U'yv. 
best to \<oxy^ 
out the logxs*- 
txcSf 'jnd the 
inteor at xon 
w}.th o^hor ^^cn 
c o n t r o 1 q r o'j p s 
ti*/eness of follow. mo the c 
first f M 3 1 y-' a r O f oper .it ic 
abDUt the foil of 
advantrvoe ot the rtOr i le peo 
and fjrs^ 'jr:.3c r nil6^"rr^ . 
t h i c u ,1 r 0 o . 




gross. v;h::^n 
.>^cc. * 'Xhx 



e, "'circulating** a^small group, giving indi- 

sttoction. All cm'riculam mteriaXs selected 
' tna t-o-^i allowed fof xndivxduiliEcd pro- 



tn..! t-O'^l allowed fof 
tl:cy tt'cv^i, the **tr.:«ckxrkq syster' 
Aith 'T'.in.nur of loss of progx^o^ 



will allov: 



p3^t inter v:c obiaj.ncj tcst^ on tv;o 
ivc u? a hnselxnc to ineasure the ef fee- 
s', xidren in our project gro^>p- Our 
n o the s c h o o 1 a g e p r o g r car^ will come 
no v.^e cr^n then assess the educational 

<:o fer \:e only ha\^e kindergarten 
'-^i'-^ c o jod .^e-^nncl , and poss i b3 y 
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The biggest drawiaack to replication is a funding source. 
The largest allocation of money in the United States for the 
benefit of migrant children is Title I-Migrant. This source of 
funding exceeds 60 million dollars. At the moment it cannot be 
used for a program such as ours, no matter how gre/xt our proof 
of effectiveness. This is because Title I must, by law, be allo- 
cated to states, who in turn allocate it to local educational 
agencies. No part of .the money is reserved for special purposes 
such as an interstate program. Although inhere is -one large inter- 
state project — the migrant record transfer system, its funding 
required the consent of every state participating and each one 
funds its proportionate share of this program. 

It has been suggested that communities in states all 
along the way might combine to jointly fund their portion of a 
mobile program such as ours. As the lead time for applying for 
local programs runs about a year (the state first determines 
priorities, then gets local applications, reviews them, etc.) this 
would require parallel programs being put together by a dozen or 
so different agencies — not a likely possibility, it would lack 
flexibility because of the long lead time — our experience is 
that each year our mobile sites have changed. Usually we have 
had very little notice of this change. 

We have succeeded only once in getting a small grant 
through Title I. This required us to make application through 
Rio Grande School District in Texas, who applied to the Texas 
Education Agency who then gave the grant to the Rio Grande 
School District. They, in turn, made Intermediate School Dis- 
trict 104 (located in Ephrata, Washington) a delegate agency to 
operate a program in La Grulla, Texas (the funds could be spent 
only during that. part of the year the program operated in Texas). 
Because Rio Grande School District has a different salary 
schedule, we had to come up with a justification for the fact 
that our salaries did not e:{actly coincide with the salary 
schedule they used. We had to duplicate all fiscal records so 
the e-xpenditures could be audited in Texas as well as in 
Washington State. These are typical problems when it comes to 
overlapping funding agencies. 

Title VII funds do not have this limitation on interstate 
programs — or did not when we first applied. Since then it has 
become increasingly difficult to meet their requirements. This 
last application "it was required that we get a sign-off from every 
school district with which we overlapped in a long-term site — 
the Rio Grande School District in Texas and with two other 
intermediate school districts in Washington State. We have suc- 
ceeded in working out a good relationship with all these agencies, 
but the administrative time increases as we are obliged to 
develop proposals which carry a heavier and heavier load of 
coordiftative steps. 
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At present the largest source of money for migrant education 
is Title I-Migrant. Cxtrfent restrictions on funding channels , 
prevent Title I from being spent for an interstate program 
such as this one. The funding and administrative structure 
that makes this program possible is a Rube-Goldberg invention 
v;ith only one redeeming quality — it works, and the children 
are making outstanding progress. 

We have succeeded in getting migrant Head Starts funds for 
the prei^chool level (only) of the mobile program. We have picked 
up URRD Washington State funding for the school--age part of the 
mobile component, when it is in Wasljington State (only). Ife have 
obtained Social Security Title IV funds for the preschool part (on; 
of the permanent centers in Washington State, and URRD funds for 
the school-age portion of this program. However, the intermediate 
school district was not eligible tb apply for URRD funds, so we 
have had to obtain the cooperation of Habton local school, district 
for these grants. They have made, the intermediate school district 
a delegate agency to run the program. Because the board ^of the 
intermediate school district is established by law, Migrant Head 
Start has preferred to place their grant with a non-profit agency 
in which migrants have a major place in board membership,. This 
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Because teachers must work on their own in isolated 
areas after being in training in Texas only a few 
months, traxning is intensive. The training has the 
teaching skills modeled by traxners, who are certi- 
fied teachers. Then teachers are observed two or 
more txmes wxth the trainer following an observation 
instrument. She: then conferences with the teacher, 
as in the picture above. Instructional gains with 
paraprof essxonai teachers wrking with xntermittent 
supervxsion have justified the effectiveness of this 
type of staff when given this type of training. 
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has meant the mobile 
component has had to 
be operated with a 
joint management 
with the Texas Migrant 
Council. The mobile 
teachers, when they 
go to other states 
such as Idaho or 
Oregon are paid c 
from the Title VII 
grant. But Title VII 
will not allow any 
funds for rent, for 
food services, or 
for transportation 
so if these have 
become needs in the 
other states, a dif- 
ferent source of 
funds has been 
required. In summary, 
we have kept the 
program alive through 
superhuman efforts 
and ingenuity in 
combining funding 
sources. We have 
come through audits 
v/ith all our separate 
accounts in order and 
none overspent. 

What is needed 
is a change in Title I' 
laws. Head Start also, 
originally, allowed 
funds to be spent only 
through local agencies. 
When it was discovered 
that this "catch th^m 
where they light" sys- 
tem was us\ially not 
reaching migrant chil- 
dren, the allocation 
of Head Start funds 
was changed. A sum of 
money was set aside 
for migrants , and 
administered from 
Washington D.C. where 
it could be used tq 
serve the children ' 
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Rewards for hard work during lesson period include such 
activities as using the typewriter as in the picture above 
Or a game of "Old Maid" with the teacher, as in the pictur 
below. Children are motivated by these changB of pace 
activities which are included in the regular scheduling. 
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wherever they are or wherever they moved and several, interstate 
programs have resulted especially designed to meet migrant needs • 

If Title I Migrant which can serve school-age or preschool 
children could similarly set aside a portion of its total grant 
allocation for use in special programs including interstate 
efforts such as this one, it could make possible immediate exten- 
sion of the program model we have developed, 

' Title I would also need to amend policies in a few other 

ways^ For one, it would have to be allowable to have a para- 
professional such as our migrant teachers working by themselves. 
Now several states require that a paraprof essional work under the 
immediate supervision of a certified teacher, and define "immedi- 
ate supervision" as on the premises, rather than the intermittent 
overseeing which our certified teacher-trainers are .able to give 
during the mobile phase. The policies would also have to allow 
some reasonable overlap, as this type of program by definition 
overlaps local efforts wherever it moves. The justification for 
this overlap would seem to be that we 'have tried the other system 
for years — uncoordinated efforts from each local school district — 
and they have not worked, or have not wd^ked well enough. 

.A mobile program has other advantages. The salary bene- 
fits go to true migrant families. Nearly all other programs 
deliberately hire their staff from people who are not migrant, in 
order to train them and be ready when 'the "migrants" arrive. A 
few migrants are hired, but they seldom have anything like the 
"career development" opportunities this program offers, because 
^local program is by definition "short term" and continued 
training and advancement is only possible through year-round 
employment and training. In "home base" our program teachers 
have put year-33g)und salaries into the migrant community, giving 
a stability to the lives of not only our teachers, but because of 
cilose relationships between fconilies, to other families near 
them. Many of our teacher 3 were adults who had left school before 
high school. Nearly all hav^e completed a GED and gone on for 
college training. All of the children enrolled have benefited 
enormously as is clearly documented by the instructional component 
findings that follow in this report. 

In summary, the mobile component of this program has 
worked. We are bil^ilding , an ever more convincing case for the edu- 
cational benefits which can follow f2;om use of adult migrants 
as teachers who serve migrant children as they move. At the 
present, however, the single largest source of money which should 
be available for .the benefit of migrant children cannot be used 
for this type of interstate program. The end goal of this demon- 
stration would seem to be, therefore, presentation of the evidence 
hoping for legislative and administrative policy changes so that a 
program that makes great sense for migrant children can be funded 
through migrant education monies. 

\ 
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Most education programs pre- and posttest on calendar dates. 
Children in migrant education programs come and go so irregularly 
that these tests are often meaningless. Few of the children post- 
tested may have been present at the time pretests were given. Or 
else the posttest measures effectiveness of very different periods 
of progiram participation. Many migrant education programs give 
up evaluation altogether . because they assume it is useless to 
measure such a short period of educational intervention.' 

This program developed a system to overcome erratic 
attendance. Each child is tested when he enters the program, 
within 30 days. He is then retested after each 100 days of 
attendance, based on the record kept individually of each child's 
cumulative attendance. This means the program is testing through- 
out the year, but when the tests ^re pulled together for analysis 
by age groups, each test represents comparable periods of program 
participation. 

The success of the program in finding a way to meaning- 
fully evaluate migrant children's educational progress earned the 
program recognition in the National Education Fai- in 1973. The 
U.S. Office of Education has also inqluded it In a list of pro- 
grams recommended as possible "dissemination" models to other edu- 
cational agencies, on a list published in 1974. 
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1. How Well Are Children Learning Preschool Concepts? 



GOAL: Project students demonstrate growth in understanding 
of preschool concepts as measured by the Cooperative 
Preschool Inventory. 

ANALYSIS: Children are tested individually, in their pri- 
mary language. Pretests are given before the child 
has attended the program for 30 days. Attendance is 
kept cumulatively on each child, and retests adminis- 
tered each time the child passes a 100--day interval. 

The project started using this test in November of 
1973. The test scores used in the analysis are 
cumulative since that date^ (Thi's represents a small 
change in the evaluation design which originally 
anticipated using only scores during the six-month 
interval preceding the evaluation. The number of 
cases available from this period was not sufficient 
for valid statistical analysis, so the larger sample 
was used.) 

Children's tests are grouped by age, and then sub- 
grouped by the. period of attendance in the program. 
The "norm" group consists of test scores of all chil- 
dren pretested before their 30th day in the program. 
Program effect would be minimal within this time 
limit. The "norm" group scores, therefore, /rfepresent 
the prqbable score of children within this target 
group, without benefit of this educational program. 
* 

Children classified as "100 day" attendance are 
tested as closely as possible to their 100th day in 
the program. In any event, thi3 subgroup goes up to, 
but does not include ch^dren ranked as "200 day" 
attendance. The attendance categories are mutually 
exclusive, unless the designation has a plus after 
it. A subgroup lifted as "300+ days" would include 
all those in the 300-4ay attendance group, plus 
children in 400 or 500,, etc., attendance groups. The 
"plus" designates all children with at least this 
amountrTr f a tt e ndance , when the combining of attendance 
groups is necessary to provide a sufficient sample 
size for statistical analysis. 
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The average (or mean^if^ score for each subgroup xs 
calculated and a comparison made. The national per- 
centile is from the mean score of subgroups, and is 
based on the national norms published for this test* 
Statistical significance is calculated by the standard 
formula for a "t" test comparing the means of small, 
unequal samples* 

CRITERIA FOR ACHIEVEMENT OF PROJECT GOAL: The cliteria is 
met if the mean score ^ of each Subgroup by age with 
100 or more days attendance is greater than that of 
the norm group of comparable age, and if the mean 
score increases with each period of attendance* 
(Analysis limited to subgroups of six or more children*) 

FINDINGS: The table below compares the average (mean) raw 
score on the Cooperative Preschool Inventory test by 
project students of comparable age, who have attended 
for different periods of time* It shows t^e differ- 
ence between the noxm group score and the mean scores 
of all subgroups who have attended more than 100 days* 
It indicates if this difference shows an increase with 
the longer periods of attendance, in keeping with the 
project objective. The final column shows whether the 
difference between the norm group score and the score 
of children with longer periods of attendance is 
enough to be statistically significant* In other 
words, significance at the .05 level would mean that 
this difference could be the result of chance less 
than five times in 100. Significance at the *01 
level would mean that the difference could occur by 
chance less than one time in 100. 
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COMPAF?ISO!l or MEAN FAW SCOPES Ot^ COOPERATIVE PF£SCHC/:)L IWtmOKi BY 
PROJECT STUDENTS WITH DIFFERJBrrr PERIODS OF PROJECT mTEWmC\u 











Does Score 


Is Difference 








Hi f f r«r ^'fi^o 


From Norm Croup 


Attendance 


Wum£K::r 


Avg. (Mean) 


From norm 


increase 


Enough to be 


by Age Group 


Raw Score 


Group Mesin 


With Longer 
Attendance? 


i:< t: a t i s 1 1 c a X i- y 












Significant? 


Age Group 












3.0-3.11 












Norm group 












under 3U days 












xoo days 












200 days 


N^6 


31.50 


9 . 64 


Ves 


Sig. .01 ie'^'el 


Age group 












4.0-4. 11 












Norm group 












Under 3U days 












xuu dayb 








Vos 


not, sxg« 


zuu d^ys 












300+ daya 


N-21 


43.90 


12.03 


yes 


Sig« «01 level 


Age group 












5.0-6.S 












Norm group 












Under 30 days 




43.08 








100 days 


N=^2S 


47-72 


4.64 




ttot sig. 


200 days 




48.73 


5.bS 


Yc 


not £.19- 


300+ days 


U--^42 


Si. 17 


8 . 09 
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SUNFIARY OF FINDINGS. TABLE 1; To summarize sor^E of the 

FiriDHiGS PRESEfJTED OU TaBLE 1: 

1. The average score of project &tudetjts after 

100 DAYS ATTEUDAfCE IS HIGHER THAU THE WORM GSOUP 

or children the same age !?{ every case. 

2. The continued increase in scored with each addi- 
tional PERIOD OF 100 DAYS ATTEF,. ED. INDICATES 
THAT children's UNDERSTANDING OF THESE ^'RESCHOOl 

concepts benefits from longer participation. 
5, By 200 days attendance preschool children 

AGE three and FOUR ARE SIGNIFICANTLY SUPERIOR TO 
CHILDREN THE SAME AGE FROM THE TARGET GROUP WHO 
ARE JUST ENROLLING IN THE PRGGRAfl. 

AJDOITIOtJAL FINOinGSj The Cooperative Freacnool Inventory xs 
a nationally standardized test, so it is possible to 
compare the scores" o€ project children with a national 
norm group. Figure 1 which follows converts the mean 
Cinw score for the various age and attendance subcjrr.upf, 
to a "national percent- ile. Tnis percentile luOi- 
cates what percentage ot children m the national s.:m!- 
ple scored lower cm this test, for e:-:arrtple. the^ 
average score of tne norm group of children in this 
pro:iect who are three years old is 22 correct answer i 
(out of 64). A score of 22 for three -year-old chil- 
dren IS at the 40th percentile. This indicates that 
m the n..-.tional san,ple 40t. of children scored even 
lower i-han this, and 60% adored hj-qher^ 
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A'^e Croup 3 . 0 - > * H 



2 00 days 




43*3 p*^f cent lie 



7ii 

percentile 



Aoi> Group 4 . o-' 4 , i X 
Le^z/s thdfi 3 0 days f^-^KO 



4lst percent xle 



100 days 



■no ,\ 



JuO-* d^y s 



36 




ilil 



i! 



ill 



57th percentile 



111 



jjijl H2tS 

llljl percentile 



than 3 0 'i'^/ 



00 



300^ .j>tys 



3 0 




ililllilllliillli 



ml 



64 th [:^->i:c^-rtt % le 



66th per cer»t 3l Xe 



1 bth 

percent i .b;i 



F.\q. 1 > - -CompcLf i son ot Mational Percentile %mk\nq ort 
^■^ooperjtwc Presc'nooi Inventory by Pr<>]ect Students 'hx-. 0 
Oif fererit Perxode of Pro ject Attendance . 
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1, CniLOKt'fi THE 'r'SG€T K>m^\ WtTHOMT ti-Mt^'lT 'j.^ 
THI? PROGRAM. Tf.?<ED TO SCOH^. {ri TH€ ?OTTOri ?0/'. 
CoriPAi^co TO CxjtD^cfi It; THri f;-nfor.'^^L , 

AfX£i? 200 DAVS ir* THt P^'O-KCT, THF AVtN;AC.i: \:OP:'r 
CHItDfiEM Iti THE ?iAT|0?JfU GAfl^'lt i 

Of CMtUDftE?i feA^KS la TK£ uPf^C^: 2V-^ 0'^* CHia?l^*€?i\ 



quest loii ^hat c-^n av??;CL* ot any prc-ri r^ot* ''v^Yo^. 
dc-ee It do tor th^ loi^^eat 'Coring /tudeAt'^'"'"/ ^i^'i^r*" 
x'hich to*.Uow:^, .:»tter»ptD to :mi-^.wer tKit qaeitJion, ^ 
-^jch ,:.<'5!e qroup It showi^v the p'^^mfc^et j^r^d petCk'nK^'^'jc o^t 
children who^w aiodjividaal ecoreo 'kould r^f& th'-,rr^ in 
^-h*? iowc <?S^ of chibiren, fc^'iv:cci o^^ thv A.*tX0'n..i\ 
'irjpipXe. J*: 5?how>: ho*** th.ir ivorf^bcx: sf^d perccrrtjoc -j* 
children xr"^ to^'* )o*.'vr qoarfxte c r .-:•■:< z.-ci t.r pr.^j:,'"' 
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Attendance Catec^ories 



Age Ctoup 
? 1 a- 3 . 1 1 



ihym Group 
mSer 30 Days 



Umiber Group: 

nuiT^Jber and Percentaq^s: 
Scorm^^ xn Lowest 2S-t 




100 Days 




200 Days 




Scar i uoweit 



Uom Group 
Under 30 Day: 




'< "^i 



100 Days 




9'* 



200 Days 




^-.i^TfO.-: t i A i> ^ oaf' 



lender 30 Oayi^ 




I DO Dayt 




200 Days 




V t 
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SUrfiARY OF FINDiNGS, FIGURE 2; To summarize the findings 

PRFSFNTFD Hi Fjfi. 2: 

1. Nearly one-third of the project preschool children, 

AGE three and FOUR, SCORE IN THIS LOWEST QUARTILE 

before they have had benefit of the educational 
program offered by this project. 

2. After 100 days attendance the percentage of chil- 
dren IN THIS LOWEST QUARTILE HAS DECREASED FOR 
every age GROUP, 

3. After 200 days attendance in the program, no 

children are STILL SCORING IN THE LOWEST QUARTILE. 

In summary, the program is quite effective in 
raising the scores of even the lowest ranking 
children in the project. 

CONCLUSION: The project objective was that the average score 
of children on the Cooperative Preschool Inventory 
would show an increase after each 100-day period of 
attendance. The findings presented here indicate that 
thxs objective v;as met. Additional analysis warrants 
the further conclusion that the program is effective 
even with the children who enter the program in the 
lowest scoring category. The superiority of project 
students passes the test of ''statistical significance" 
beyond the level of chance for three- and four-year- 
old children after 200 days attendance, and with 
kindergarten age children, after a period of 300 days 
attendance . 
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I 2a How Well Ha ve Children L earned Two Languages? j 

GOAL: Project students demonstrate growth in l.^iiguage 

understanding in both Spanish and English as mea- 
sured by the Peabody Picture Vocabulary Test, 

Al^ALYSIS: Children are tested individually, using Form A 
of the Peabody Picture Vocabulary Test in English, 
and 'Form B in Spanish. Pretests are given before the 
child has attended the program for 30 days. Atten- 
dance is kept cumulatively for each child and retests 
given after each 100-day attendance interval. Tests 
representing the various attendance intervals are 
grouped for analysis at evaluation dates. 

>. 

Gains analysis is based on the raw score gain from 
the previous test to the present test (approximately 
a 100-day attendance period). Each evaluation reports 
on children post- tested at any time during a six-month 
calendar period preceding the date of the evaluation. 
This evaluation is labeled "Wave 5" to distinguish 
it from previous evaluation groups. It consists of 
children who passed a testing point between April 1 and 
September 30, 1974. "Gains analysis" consists of 
making a roster 6f children in the Wave 5 evaluation 
group. Each child *s gain or loss is recorded, 
separately for his "primary" and his "second" 
language. "Primary" language is considered to be 
the language on which he received the highest total 
score based on the last test given . The percentage 
of the evaluation group with a gain of 5 or more 
points is then- determined to see if the project 
objective has been met* 

CRITERIA FOR ACHIEVEMENT OF PROJECT GOAL: The criterion is 
met if the percentage of children meeting the 5-point 
gain standard is greater than 50% in both primary and 
second language. 

FINDINGS: Table 2, which follows, reports the number and 

percentage of children who gained 5 points or more in 
their raw scores, classified by whether the gain was 
in their primary or in their second language. 
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TABLE 2 

GAINS IN ENGLISH AND SPANISH RAW SCORES ON THE PEABODY 
PICTURE VOCABULARY TEST BY PROJECT STUDENTS AFTER 
APPROXIMATELY 100 DAYS ATTENDANCE INTERVAL 
BfiTWEEN TESTS 



, , • Number with Percentage Meets Average 

Nxunber m ^^^^ ^ points Over 5 Points Project Point 

Test Group g^.^ q^^^ goal? Gain 

Gains in Primary Language: 

67 38 57% Yes 8.58 
Gains in Second Language: 

66 27 41% No 4.98 



SUMMARY OF FINDINGS. TABLE 2; 

1. The majority of project students showed a 
language gain in their primary language which 
exceeded the project goal. 

2. The average gain in primary language was 50% 
higher than the 5-point gain set as a goal. 

3. The average gain by children in their second 
language was 4.98 points/ very close to the 
5. .00 point goal. however/ the percentage of 
children making this much gain was less than 
50% of the total group tested. 

INTERPRETATION OF FINDINGS: The "5 point gain" established 
as an arbitrary goal was based on the fact that on 
this test/ between ages three and six, this repre- 
sents approximately the "expected" increase a child 
would make in a six-moiith period based on national 
• norms for this test. The greatest number of project 
children complete a 100-day period of attendance 
within a six-month period, so this represents a rough 
standard of "normal" language development, and a gain 
exceeding the 5-point standard woulcJj^ represent a 
somewhat accelerated language development- 
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There is no reasonable basis for "expecting" any 
amount of gain in a child's second language, so the 
''same gain standard was set on an arbitrary basis. Its 
primary value is^ in allowing the project to see 
whether the "rate" of second language development is 
increasing from one evaluation period of six months, 
to the next, as changes are made in the curriculum. 

The record of second language gains for the past 
thtee evaluations is as' follows: 

Percentage of Children 

Gaining 5 Points or 
More in Their Second 
Language 

A. Mid-year evaluation 

1973-74 program year: 29* 

B. End-of-year evaluation 

1973- 74 program year: 41% 

C. Mid-year evaluation 

1974- 75 program year 

(this evaluation) : 41% 

After the evaluation labeled "A" above, the educa- 
tional director developed a training unit on dual 
language teaching which he carried out at all centers. 
An observation instrument for use by trainers on 
dual language teaching was also put into use. The 
benefits of these efforts seeiiv to be reflected in 
^the findings above. 

Site visits were also started to other programs in 
search of more effective curriculum for the develop- 
ment of second language skills. In April, 1974, the 
decision was made to adopt the DISTAR language 
development program, using it bilingually based on 
the Spanish version developed at East Las Vegas, New 
Mexico and Uvalde, Texas. 

Materials were ordered, training consultants brought 
in, and implementation began in mid-summer at the two 
permanent centers in Washington State. The Texas 
based program was, by then, in its mobile phase. It 
is extremely difficult to introduce new curriculum 
materials while teachers are dispersed in six or 
eight different locations, many teachers providing 
services working alone in isolated areas with inter- 
mittent support frpm training staff who "^travel from 
site to site. It was therefore decided to have the 
mobile project teachers who were in Washington State 
(other teachers were in Oregon and Illinois) attend 
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training on the new curriculum during the siMmerr 
but full training and implementation of the new' 
curriculum was not undertaken until the fall of 1974 
when the program resumed operations in Grulla, Texas. 

As the group of children reported in this evaluation 
"Wave" were tested between April and September^ 1974, 
it therefore represents a "transition" period. Some 
of the children in this evaluation group had been 
^ into the new curriqulvim for a few weeks at the time 
they were tested; most had no experience with it. 
The effects of the new curriculum will not begin to 
be measured, therefore, until the end of program year 
evaluation for 1974-75. As the program is finding 
extensive xevisidn necessary with thp 'materials to 
adapt them to our use, the effectiveness will not be 
clear until two or three evaluation periods have 
passed. 

ADDITIONAL FINDINGS: A longer term evaluation analysis on 
language gains was undertaken for this report beyond 
that required by the evaluation design. The first 
part was to answer the following question: 



How well is this program doing in helping 
Spanish speaking children retain and 
improve their skills in their primary 
language? 



This has been one of the long-term goals of the 
program. Until the recent rekindling of interest 
in bilingual education, most Spanish speaking 
children have been forced into English-only class- 
rooms, in which their native language skills were 
neglected, even sometimes punished. Academic 
instruction and cultural enrichment activities in 
this program are carried out in both languages. 
This is in addition to the portion of the academic 
day related directly to "teaching" language as a 
subject area. 

When preschool children first enroll in this pro- 
gr^, the level of their language skill represents 
home usage, rather than the language of instruction. 
In the past three years the accumulated scores of 
children pretested as they entered the program rep- 
resents a "norm group" of the level of language 
skills characteristic of this .target group before 
they participate in the program. For this evaluation 
the scores of all Spanish dominant children pretested 
before 30 days in the program and those who have 
attended 100, 200, and 300 or more days were 



ERLC 



32 



accumulated and analyzed based on the child age 
at the time of testing. If the project was meeting 
its long term goal, each successive period of 
attendance should result in a higher average score. , 
in Spanish for Spanish speaking children. This would 
mean that participation in the program was giving^ the 
children a stronger COTimunication ability in Spanish 
than children of "their age without benefit from such 
a program. 

This three-year analysis of test scores of Spanish 
dominant children confirms this result. Each atten- 
dance period results in a widening gap by which pro- 
ject children are superior to children of their age 
before program participation. These findings are 
presented in detail in Fig; 3, which follows. 
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Pig^ 3,— Comparison of Average (Mean) Scores in Spanish, Measured by the 
Peabody Picture Vocabulary Test, of Project Students for Whom Spanish is 
the Primary Language, by Different Periods of Project Attendance 



28 



Attendance 
Age Group 3,3-3.8 

Norm Group, Less than 30 Days N=42 



100 Days 



N=20 



Mean Raw Score 



22.0 



\ 26.50 



(1) 



Norm Group, Less than 30 Days 


N=35 


1 








III 


1 




II 


100 Days 


N=14 














III 


III 


200 Days 


N=7 





Age Group 4.3-4.8 

Norm Group, Less than 30 Days N=25 
100 Days 

200 Days 

Age Group 4.9-5.5 

Norm Group, Less than 30 Days N=^29 
100 Days 
200 Days 

Age Group 5.6-6.5 

Norm Group, Less than 30 Days N=ll 

N=21 ! 



100 Days 
200 Days 



N=20 



30.8 



(1) 



32.57 



(1) 



26.96 




30.90 



(1) 



•36.0 



33.69 



(3) 




37.91 



(2) 



40.27 



(3) 



39^36 




43.67 



(1) 



46.7 



(3) 



Although the difference between this score and that of the norm 
group for this age is in the direction called for in the project objective, it 
is not sufficiently large to be statistically significant. 

^^^Xhe difference of this score over that of the norm group for this 
age level is sufficiently large to be statistically significant at the .05 level 
(e.g., it would occur by chance less than five times in 100). 

^"^^The difference of this score over that of the norm group for this 
age level is sufficiently large to be statistically significant at the .01 
level (e«g., this difference would occur by chance less than one time in 100). 
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SUMMARY OF FINDINGS. FIGURE 3; ^ 

1. After 100 days, in the program, the twerage 
score of children in every age classification is 
higher than that of the norm group. 

2. For children of the age to enter kindergarten 
(^.9-5.5) the superiority of the-children with 
IQQ days attfndance over the norm group is 

ENOUGH TO BE STATISTICALLY SIGNIFICANT ABOVE A 
RESULT THAT MIGHT HAVE COME ABOUT BY CHANCE 
(the .05 LEVEL OF SIGNIFICANCE). 

3. For children in the age groups from ^.3 to 6.5 

the superiority of project children after 200 DAYS 
ATTENDANCE IS EVEN GREATER. ENOUGH TO BE STA- 
TISTICALLY significant at the .01 LEVEL WHICH 
MEANS THAT THE PROBABILITY THAT THiS MUCH DIFFER- 
ENCE COULD BE ATTRIBUTED TO CHANCE IS LESS THAN 
ONE IN- 100. 

ADDITIONAL FINDINGS: The Peabody Picture Vocabulary Test 
scores from the last three years were analyzed in 
another way to answer the following evaluation ques- 
tion: 

How well has the program succeeded in helping 
Spanish speaking children learn English? 

This is another of the goals'* of the program; to give 
Spanish speaking children enough knowledge of English 
so they can benefit from instruction in either 
language. 

To answer this questioh, analysis was made of all 
children who had been in the program for 200 or more 
days and who were tested as "Spanish dominant" at the 
time they entered. There were 75 children in this 
group. Out of these, 50 would be classified as 
"monolingual" Spanish speakers at the time they 
entered the program! These are children who come 
from homes in which there is little or no use of 
English to reinforce what the children learn in the 
program. The remaining 25 children entered the 



ERIC 



35 



30 



program with Spanish as the dominant language / but 
with English scores at least 50% or better as high as 
their scores in Spanish • On this basis they would 
be classified as having a bilingual capability on 
program entry. In the homes of these children there 
is some use of both languages. 

The following table analyzes the range and distribution 
' of gains made by these children within their first 
200 days attendance in the program. As the project 
goal for each evaluation during this period 'has been 
a minimum of 5 points gain per 100 days attendance/ 
a 10 point gain is taken as the gain goal for 200 days. 



TABLE 3 

RAW SCORE GAIN IN ENGLISH ON PEABODY PICTURE VOCABULARY TEST, 
AFTER 200 DAYS ATTENDANCE IN PROGRAM, BY CHILDREN WHOSE 
PRIMARY LANGUAGE AT ENTRY WAS SPANISH 



Points 
Gained 


Bilingual Group* 
Number =25 


Monolingual Group* 
Number = 50 


Both Groups" 

Combined 
Number = 75 


0 


1 (4%) 


8 (16%) 


9 (12%) 


1-9 


7 (28^) 


16 (32%) 


23 (31%) 


10-20 


6 (24%) 


12 (24%) 


18 (24%) 


21+ 


11 (44%) 


14 (28%) 


25 (33%) 



Number and Percentage of Children Gaining 10 Points or 
More in 200 Days Attendance / to Meet Project Goal 



17 (68%) 



. 26 (52%) 



43 (57%) 



*Bilingual group is children whose score in English is at 
least 50% as high as their score in Spanish at the time of 
initial enrollment. Monolingual group is children with scores 
in English less than '50% of their score in Spanish (usually a 
very negligible score) • 



SUMMARY OF FINDINGS. TABLE 3 : 

1. During three years of program operations the 
GAINS IN English of Spanish speaking children 

HAVE MET THE PROJECT GOAL OF 10 POINTS OR MORE 
GAIN IN 200 DAYS ATTENDANCE FOR 57% OF THE 
CHILDREN. 

Er|c ' 3G 
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2. Children ranked as having some bilingual capa- 
bility ON initial enrollment made proportionately 

LARGER gains IN ENGLISH THAN CHILDREN RANKED AS 
MONOLINGUAL SPANISH SPEAKERS ON ENTRY. 

3, Even the group of children initially identified 
as monolingual spanish speakers made gains 
sufficient in english to meet the project goal 
for 52% of the children. 

The scores of these 75 children were analyzed in a 
different way to show the change in their language 
classification as their English skills have increased 
through program participation. For this purpose 
their initial test scores are compared to their 
scores on their latest test, on Table 4. 



TABLE 4 



LANGUAGE CLASSIFICATION OF CHILDREN WHO WERE SPANISH DOMINANT 
UPON INITIAL ENROLLMENT IN THE PROGRAM WHO HAVE ATTENDED 
THE PR0GRAI4 AT LEAST '200 DAYS 



Total number in group 

Children whose score* in 
English is equal to or 
greater than their score 
in Spanish 



On Entry to Program On Latest Test 



75 



75 



24 (32%) 



Children whose score in 
English is at least 50% 
of their score in Spanish 

Children whose score in 
English is less than 50% 
of their score in Spanish 
but is 10 points or more 

Children whose score in 
English is considered 
negligible, being 9 points 
or less 



25 (33%) 



9 (12%) 



41 (55%) 



28 (37%) 



20 (27%) 



3 (4%) 



*Scores are from the Peabody Picture Vocabulary Test. 
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SUMMARY OF FINDINGS. TABLE A; 

1. Of the 55% of children who had "negligible" 
SCORES IN English upon entry to the program. 

ONLY m remain in THAT CATEGORY AFTER 200 OR 
MORE DAYS PARTICIPATION IN THE BILINGUAL PROGRAM. 

2. Nearly one-third (32%) of the children originally 

CLASSIFIED AS SPANISH DOMINANT NOW HAVE AN EQUAL 
OR GREATER CAPABILITY IN ENGLISH. 

3. The combined categories of children whose 
Spanish and English are now approximately equal, 
and those whose English is strongly approaching 
THEIR Spanish score (more than 50% as great) 
represent 69% OF the total group. 

CONCLUSION: The project goal of a gain of at least 5 points 
in the child's primary language by 50% or more of the 
children was met and exceeded for the most recent 
group of children, covered by this. evaluation. Aver- 
age gains were approximately 50% higher than the pro- 
ject goal. 

The goal of 50% or more of the children making at 
least a 5-point gain in their second language, was 
partially met as 41% made this much gain. The aver- 
age gain, however, was 4.98, only .02 short of the 
5.00 goal. 

The analysis of gains in Spanish by children for 
whom Spanish is the dominant language over the last 
three years indicates that project children, after 
100 days, average scores consistently higher than the 
norm group of comparable age. By 200 days attendance 
this superiority over the norm group is large enough 
to be statistically significant beyond the .01 level 
of chance occurrence. The project, therefore, seems 
to be achieving its goal of retaining and developing 
ability in Spanish for children for whom this is the 
primary language. 

The analysis of gains in English by children who 
entered Uhe project as Spanish dominant over the 
last thr^e years shows that 96% have scores higher 
than 9 pdirrts (the classification for "negligible" 
knowledge of English), after 200 or more days, 
although 55% of these children entered the program 



with ''negligible^' knowledge of English. Of this 
three-year evaluation group, 32% {almost one-third) 
have reached the project'::; loucr-tenn goal of having 
children ecpaally competent in English and Spanish, 
and able to benefit from instruction in either 
language. Another 37% (for 69% overall) is approach 
ing this goal, having scores in English which are 
now 50% more of their score in Spanish on the PPVT. 
The program seems to be having a significant effect, 
therefore, in giving Spanish speaking children 
communication skills in English. 



5. How Well Are CHitDREti LEAR?jirit5 '''ath Coucepts? 



COAL; Project students den.onstrate growth in tt^ath concepts; 

as measured by the Wide Range Achjievement Test, ivabtest 
on rnath. 

AW.«OLVSIS: The Wide Range Achievement Test, math s^Jtbsectioo , 

IB admin istf?red to children xRdividuaily , with instt'jc- 
tions given in the child's primary language. 

Pretests are given within 30 days after the child's 
initial enrolljpent, and subsequent tests given at 
calendar points in the year preceding each half-year 
evaluation, provided that the child has attended at 
least 40 days since the pretest, 

the Wide Range Achievement Test is normed to a national 
sample and has "grade equivalent" norms based on the 
child's grade placement, and the month in the school 
year. Using age to correspond to the grade placement, 
and the month of testing to determine the month in the 
school year, actual scores are c.^mpared to the "ey.pected 
score, based on the grade equivalent norms. The per- 
centage of children whose actual score is the saF<e or 
greater than the "expected" score for the grade level 
and month in the school year is reported in the analy- 
sis reporting number of children "at or above grade 
level. " 

For this analysis, the children in the evaluation group 
(tested September to December, 1974) are divided into 
subgroups by grade level based on age, and by whether 
they have attended the program 100 days or 200+ days. 
For each qrade level a norm group is also analyzed, 
consisting of all children pretc-itt-d within the JO-day 
limit since the project began using this test, in 1973. 
The percentage of children at or above grade level is 
calculated for each subgroup in which there are S4;< 
or more children, to see if the percentage increases 
with increased pentads of program attendance. 

Another type of analysis concerns the gains made by 
children in cneir "grade equivalent" Ecores, i>.g., how 
many months increase (or decrease) Hai^ t.^ken place trom 
pretest to posttest. This increase is compared to the 
number of 20-day periods ot attendance- in the program 
from pretest to posttest, with the project goal of an 
increase of one month m grade eguivalent score tor 
each 20-day period of project attendance. 
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c(^n£f^%h FOR ACHlEV£?^iL^n OF PROJECT GOAL: For the analyses 
ot ctnldren who are '^-^t or above gxade level*' the 
project qoal met if the percentage o£ children at 
or above grade lewjl »Anthin each grade level increases 
wxth each increase xn attendance xn the programr pro-, 
vided there are at lea&t sxk children v.^ith scores to 
be aXi^Hyzed xx\ the subgroup* 

For the analysis of gams in grade equivalent score, 
the criteria are net if 50% or itt^ore of the children 
have gained at least one month in grade egtiivalent 
. score for each p^*rto4 ot 20 days attendance from pre- 
to posttest. 

tinoVACSi Tabie % below 5how£ the percr,*ntage of childreri 
v^hose actual scores on the math sectxon of the Wide 
Range Achfever»ent Test ate at or csbove o-rade level, 
t^sed on n^tionai noms. 

^>UH SCORES- -]P£?^CeiaTACE OF CHIU5RE^ AT ABOVE GRADE LE\^EL 0^SED 
Oti ^R;a>E EQUIVA1.EI'^T SOFi^S FOE TH£ WIDE RANGE 
ACHlE\^n«»T TEST 



( 3 - r - o I o i ) n 4 4 I it 0 \ U ^ 3 I U 0 H - 3 1 0 V 
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SUMMARY OF FiriDINGS, TABLE 5: 

1. HiTH INCREASED PERiODS OF PROGRAM ATTENDANCE^ THE 
PERCENTAGE OF CHiUDREN AT OR ABOVE GRADE LEVEL 
INCREASES/ EXCEPT WHEN THE PERCENTAGE HAS REACHED 
100% AND CAN GO NO HIGHER. 

2. By 200 DAYS attendance in the program, 100% of . 

CHILDREN HAVE MATH SCORES WHICH ACCORDING TO 
NATIONAL NORMS vJoULD PUCE THEM ABOVE GRADE LEVEL. 

INTERPRETATION OF FINDINGS: , The Wide Range Achievement . Test 
was standardized v;ith children aged 5 years and older. 
The expected scores used in the grade equivalent norms 
for preschool grade levels, therefore, represent a 
projection dovmward based on the slope of scores 
obtained by children from kindergarten up. This means 
the norms have a weak statistical support at this level. 
That the "eKpected" score is too low at the three-year- 
old level would seem evident from the fact that even 
the norm group achieved the expected score by 100%. 
The reader is therefore referred to later analysis in 
this section in vjhich the mean raw scores for the 
various subgroups are compared statistically, as 
being a stronger confirmation of the superiority of 
the pic'ject childi-eff attending 100 and 200 days. 

ADDITIOimL FINDINGS J ^,nother type of analysis called for in 
the evaluation is based on the gains made by children 
jn terms of the grade equivalent of their score on the 
math test. For this analysis, the criterion set was 
that at least 50% of the children would show an 
increase of at least one month in the grade equivalent 
of their score on the math test for every 20 days theyi 
had attended since their previous mhT test. The size; 
of the evaluation group for this analysis is larger 
because it includes any child v/ho attended at least 
40 days between tests, whereas the other types of 
analysis made the cut-off for inclusion in the evalua- 
tion group after 100 days attendance. Ths findings 
are presented below in Table 6 . 
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TABLE 6 



INCREASE IN GRADE EQUIVALENT RANKING BASED ON MATH SCORES FROM 
WIDE RAtJGE ACHIEVEMENT TEST RELATED TO LENGTH OF PROGRAM 



ATTENDANCE 


Number of Children 
with Pre- and Post- 
tests on W.R.A.T. 


Number who Gained 
at Least One Month 
in Grade Equivalent for 
Each 20 Days Attendance 


Meets Project 
Goal Criteria 


78 


58 (74%) 


Yes 



SUfflARY OF FINDINGS. TABLE 6: 

1. The evaluation criterion was that at least 

OF project children would SHOW A GRADE EQUIVALENT 
RANKING AT LEAST ONE MONTH HIGHER FOR EACH 20 DAYS 
THEY SPENT IN THE PROGRAM. ThIS RATE OF GAIN WAS 
MET BY 7^% OF THE CHILDREN. FAR EXCEEDING THE 
MINIMUM GOAL. 

INTERPRETATION OF FINDINGS: As 20 days attendance is toughly 
the equivalent of one month of school, a gain of J 
one month in grade equivalent provides, a rough^^an- 
dard of whether progress is at a "normar^ate. As 
indicated, the overwhelming majority of students are 
showing dn accelerated rate of gain in math for the 
period of actual attendance. 

ADDITIONAL FINDINGS: Additional analysis of test scores is 
reported in Table 7. in this analysis the average 
(mean) raw score achieved by the different attendance 
subgroups is compared. A statistical test is used to 
see if the superiority of the children who have 
attended 100 and 200 days is large enough to be "sta- 
tistically significant" — i.e., the possibility that 
this is not a project effect but the result of "chance" 
differences is less than 5 in 100. 
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MATH SCORES— COMPARISON OF AVERAGE (MEAN) MATH SCORES ON THE 
WIDE RANGE ACHIEVEMENT TEST BY AGE AND PERIOD OF 

^TENDANCE 



Attendance in Program 



Age Group 


Norin 
Under 


Group • 
30 Days 


100 Days 


200+ Days 


3.0-^.11- 


N=44 


3.59 


N=8 7.25** 


« • • 


4 . OM . 11 


N=28 


5.61 


N=12 9.25** 


N=6 10^.67** 


5.0-5.11 


N=14 


8.29 


N=15 15.27** 


N=10 1^-190** 


6.0-6.11 


N=10 


15.40 


N=8 19.50^^ 


• • • 



N = number in the subgroup. 



. • . indicates there were fewer than six children in the 
subgroup/ so no analysis of scores was made. - 

** = the superiority of this score over that of the norm 
group is statistically significant at the .01 level. 

NS = the difference between this score and the norm group 
is not large enough to be statistically significant above the 
.05 level. 

SUMMARY OF FINDINGS. TABLE 7: 

1. In every age grouP/ the average math score 
increases as the period of attendance increases. 

2. The super^iority of three-, four-, and five-year- 
old CHILDREN attending 100 AND 200 DAYS OVER THE 
NORM GROUP/ WHICH REPRESENTS CHILDREN OF THE SAME 
AGE WITHOUT PROGRAM EXPERIENC-E, IS SO GREAT THAT 
IT COULD RESULT FROM CHANCE LESS THAN QHL TIME 

IN 100. 

3. The average score in math of six-year-old children 
shows the group with 100 days attendance superior 
to the norm group of this age/ but the difference 
is ml enough to be considered statistically 
significant. 
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CONCLUSION: Comparison of the scores of project children to 
national norms shows an increased percentage of 
children who are "at or above grade level" for each 
increased period of iparticipation in the t>i^ogram. 
In addition, 74% of xhe children. show an increase in 
their grade equivalent score which exceeds the expected 
increase based on their period of attendance in the 
program. These two findings indicate that the program 
has met/ and exceeded its goals for teaching of math 
concepts. ^ 

A further analysis of scores based on length of 
attendance in the program shows that even by 100 days, 
children have a superiority over the norm group with- 
out program experience which is large enough to be 
statistically significant at the .01 level. By 
200 days this superiority is even greater. 

All of these findings indicate that ^the academic program 
in math is very powerful. Project children enrolled 
as preschoolers begin school with a very significant . 
superiority over children of similar age and background 
without benefit of such instruction. 



How Well Are Children Learning Handwriting and- 

SPELLING SKILLS? 



GOAL; Project students demonstrate growth in handwriting 
and 'spelling skills as measured by the Wide Range 
Achievement Test, subtest on spelling. 

AfjALYSIS: The test is administered individually, with 

instructions given in the child's primary language. 
Two types of analysis are called for in the evalua- 
/ tion design: (1) the percentage of children at or 

above grade level, and (2) the percentage of children 
increasing t^heir grade equivalent score by at least 
one month for every 20 days of attendance in the 
program between tests. ^ 

The process of analysis is the same as that described 
in the previous section concerning the math subtest 
of the WRAT. The reader is referred to that dis- 
cussion. ^ 

CRITERIA FOR -ACHIEVEMENT OF PROJECT GOAL: For the first 

analysis described above f the goal is met if the per- 
centage of children at or above grade level within each 
age group increases with each increase in attendance 
in the program, provided there are at least six chil- 
dren with scores to be analyzed in the subgroup. 

For the second analysis described above, the goal is 
met if 50% or more of the children have gained at 
least one month in grade equivalent score for each 
period of 20 days attendance from pre- to posttests. 

FINDINGS: Table 8 shows the percentage of children whose 

actual score on the spelling subtest of the Wide Range 
Achievement Test is equal to or higher than the scor6 
expected for his grade level based on the national 
norms. Although the subtest is called "spelling," at 
the preschool level it is based on the ability to copy 
marks and make letters and is therefore closely 
related to handwriting skills, and is used as a 
measure of the effectiveness of the handwriting 
curriculum* 
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SPELLING SCORES— PERCENTAGE OF CHILDREN AT OR ABOVE GRADE LEVEL 
BASED ON GRADE EQUIVALENT NORMS FOR THE WIDE RANGE 

ACHIEVEMENT" TEST 



Attendance in Program 



Age Group 



Norm Group 100 Days 

Under 30 Days Attendance' 



200 Days 
Attendance 



Nursery 
(3-year-olds) 

Pre-kindergarten 
(4-year-olds) 

Kindergarten 
(S-year-olds') 

First Grade 
(6-year-olds) 



N=44 32% 

N=28 36% 

N=14 29% 

N=9 m% 



N=8 100% 



N=12 83% 



N=15 73% 



N=8 



0% 



N=2 100% 



N=6 100% 



N=10 100% 



N*l 100% 



SUMMARY OF FINDINGS. TABLE 8: 

1. The percentage of children whose score places 
them at or above the expected score for their 
grade level increases with longer periods of 
program attendance for three"/ four-/ and five- 
year-olds/ in keeping with the project goal. 

2. In first grade/ all children except one in the 

NORM GROUP ARE BELOW GRADE LEVEL. ThIS MEANS THAT 
the percentage ABOVE GRADE LEVEL IN THESE TWO 
GROUPS GOES FROM 11% TO 0%/ OPPOSITE TO THE 

direction expected for the evaluation, 

3. All children with 200 days attendance have scores 
' which are at or above that expected FOR their 

age group. 



INTERPRETATION OF FINDINGS: The preschool level of this test 
is based on handwriting skills, which are taught in 
the program. By the first grade the test content 
includes spelling of words. The program teaches 
reading, but it does not teach spelling at the firsts 
grade level so differences between the groups are not 
related to the instructional program. In addition, 
the handwriting curriculujn is not taught in the 
school age program because we have less time with 
these children. 

ADDITIONAL FINDINGS: Based on grade equivalent scores, the 
project goal was that children from, pre- to posttest 
would gain one or more months in the gradeXequivalent 
score for each 20 days attendance in the program. The 
criterion set was that 50% or more of the children in 
the evaluation group would meet this goal. Table 9 
below presents findings^ on this objective. 





TABLE 9 




HANDWRITING OR SPELLING— INCREASE IN GRADE EQUIVALENT RANKING BASED 
ON SCORES FROM THE SPELLING SUBTEST OF THE WIDE RANGE ACHIEVEMENT 
TEST RELATED. TO LENGTH OF PROGRAM ATTENDANCE 


Number of Children 
With Pre- and Post- 
tests on WRAT 


Number Who Gained 
at Least one Month 

in GE for Each 
20 Days Attendance 


Meets Project 
Goal Criteria? 


78 


44 (56%) 


Yes 



GE = grade equivalent (based on month of school year) . 



SUMMARY OF FINDINGS. TABLE 9: 

1. Forty-four children/ which is 56% of the children 
in the evaluation group/ increased their scores 

enough- TO RAISE THEIR GRADE EQUIVALENT RANKING BY 
AT LEAST ONE MONTH FOR EVERY 20 DAYS ATTENDANCE 
BETWEEN TESTS. ThIS MEETS THE PROJECT GOAL. 
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INTERPRETATION OF FINDINGS: This analysis was intended only 

as a very rough measure of the children's rate of gain, 
as 20 days is the equivalent of one month of schooling , 
and the grade equivalent noinns are based on scores 
achieved by a national sample in different months of 
the school year. 

ADDITIONAL FINDINGS: Both of the last two tables related 

the scores of project children to the grade equivalency 
scale developed for the Wide Range Achievement Test. 
The following analysis compares the average raw 
scores of children in the norm group (without program 
participation) with children of the same age who have 
attended 100 and 200 days. This shows the same pattern 
as the comparison of the percentage of children at 
or above grade level; namely each group with higher 
attendance shows a higher average score among three-/ 
four-, and five-year-olds, with^ a slight reversal 
among six-year-old first graders. However, the 
differences -in scores is analyzed statistically to 
see whether it is significant (meaning that the differ- 
ences between the groups might occur by chance less 
than 5 times in 100) . This provides a much stronger ^ 
confirmation of the superiority of project children 
after 100 and 200' days attendance. 



TABLE 10 

HANDWRITING OR SPELLING— COMPARISON OF AVERAGE (MEAN) SPELLING 
SCORES ON THE WIDE RANGE ACHIEVEMENT TEST, BY AGE, AND PERIOD 

OF ATTENDANCE 

Y 



Attendance in Program 





Age Group 


Norm 
Under 


Group 
3 0 Days 


100 


Days 


200 


Days 


3. 


0^3.11 . 


N=44 


.61 


N=8 


3.25** 


• 


« • 


4. 


0-4.11 


N=28 


3.00 


N=12 


5.92* 


N=6 


9.33** 


5. 


0-5.11 


N=14 


6.36 


N=15 


12.53** 


N=10 


17.60** 


.6. 


0-6.11 


N=9 


17.0 


N=8 


16. 75^^ 


• 


• • 



N = number in subgroup. 

. . . indicates there were fewer than six children in the 
subgroup, so no analysis of scores was made. 

* indicates the difference between this score and the norm 
group is significant at the .05 level (would occur by chance less 
than 5 times in 100) . 

** indicates the difference between this score and the norm 
group is significant at the .01 level (would occur by chance less 
than 1 time in 100) . 
O NS = the difference between this bcore and the norm group 

EBs][C is not statistically significant. ^p^. 
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SUMMARYxOF FINDINGS. TABLE 10: 

1. x The effect of the handwriting curriculum is shown 
\by the fact that the average score increases 

SHARPLY THE LONGER THE PERIOD OF ATTENDANCE. FOR 
' THREE-, FOUR-. AND FIVE-YEAR-OLD CHILDREN. (At 

this age level the test is more of handwriting 
skills than of spelling.) 

2. The superiority of the children with 100 and 
200 days\ attendance over the norm group is sta- 
tistically signif icant. e.g.. beyond the level 
when it could be attributed to chance. 

3. The difference between the norm group and children 
with 100 days attendance for six-year-olds is not 

STATISTICALLY SIGNIFICANT. (ThIS IS NOT UNEXPECTED 
-AS NEITHER HANDWRITING NOR SPELLING ARE SPECIFICALLY 
TAUGHT AT THE FIRST GRADE LEVEL.) 

CONCLUSION: The handwriting program at the preschool level 
appears to be very effective. The program met its 
goals for each of the types of analysis called for 
in the evaluation plan with all preschool age groups. 
The program does not teach spelling or handwriting 
at the first grade level, and the scores of these 
children were essentially the same as those of the 
norm group for this subject ctrea. 
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5. How Well Are Children Learning Reading Skills? 



GOAL: Project students demonstrate growth in reading skills 
as measured by the Wide Range AchievementTest, subtest 
on reading. 

ANALYSIS: ^he Wide Range Achievement Test is administered^ 

individually to students, the reading subtest adminis-- 
tared in English. 

The analysis used in the evaluation of reading gains 
is the same as that used with the math and spelling 
subtests of the WRAT, and the reader is referred to 
the description included earlier in objective 3 
regarding math. 

CRITERIA FOR ACHIEVEMENT OF PROJECT GOAL: The percentage of 
children scoring at or above grade level will increase 
with attendance in the program. National norms on 
the , WRAT indicate which is the average score received 
by children in various months of the school year for 
grade levels from Nursery (S-^year-olds) upward. ^ This 
score is considered the "expected" score for children 
tested in that month of that grade, and children whose 
actual score is as high or higher than their "expected" 
scpre are considered to be "at or above grade level." 

FINDINGS: Table 11 below compares the percentage of children 
who are at or above grade level in the norm group (less 
than 30 days attendance) and in groups made up of chil- 
dren who have attended over 100, or over 200 days, 
by age groups. 

Thete are fewer children in the norm group and in the 
200 day subgroup for reading than for math and hand- 
writing because the reading program was begun several 
months later than the other two subject areas, and 
the reading subtest was not included in the WRAT 
testing un,til approximately one year ago. 
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READING SCORES—PERCENTAGE OF CHILDREN AT OR ABOVE GRADE LEVEL 
BASED ON GRADE EQUIVALENT NORMS FOR THE WIDE RANGE 

ACHIEVEMENT TEST 



Attendance in Prograin 



Age Group 



Norm Group 100 Days 

Under 30 Days Attendance 



200 Days 
Attendance 



Nursery 
(3-year-olds) 

Pre-kindergarten 
(4-year-olds) 

Kindergarten 
(5-year-olds) 

First Grade 
(6-.y6ar-olds) 



N=13 77% 

N=14 79% 

N=6 67% 

N=8 25% 



N=8 100% 

N=16 100% 

N=20 95% 

N=8 13% 



N=l 100% 

N=3 100% 

N=3 100% 

N=l 100% 



N = number in subgroup. 



SUMMARY OF FINDINGS. TABLE 11: 

1. The percentage of children with scores in reading 
at or above grade level is higher for children 
with 100 and 200 days of attendance than in the 

NORM 'group for THREE", FOUR-/ AND FIVE-YEAR-OLDS. 

2. Most first grade children in both norm group and 

WITH 100 DAYS attendance ARE BELOW GRADE LEVELj 

the percentage above favors the norm group. 

3. All children with 200 or more days attendance 
have reading scores which would place them above 
the national norms. 

ADDITIONAL FINDINGS: The rate of increase in reading skills 
was evaluated, by seeing how many children showed an 
increase of at least one month in the grade equivalent 
of their reading score for each 20 days attendance 
between pre- and posttest. For this analysis all tests 
were evaluated in which there had been at least 40 days 
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attendance from pre- to posttest. The grade equiva- 
lent norms are based on the score most frequently 
achieved by children of that year and month in school. 
Below 5 years of age these are a projection downward 
of the scores of children aged 5 and older. 



TABLE 12 

READING— INCREASES IN GRADE EQUIVALENT RANKING BASED ON READING 
SCORES FROM WIDE RANGE ACHIEVEMENT TEST RELATED TO LENGTH OF 

PROGRAM ATTENDANCE 

\ 



Number of Children 
with Pre- and Post- 
tests on- WRAT 


Number who Gained 
at Least One Month 
in Grade Equivalent for 
Each 20 Days Attendance 


Meets Project 
Goa\ Criteria? 


54 


29 (54%) 


Yes 



SUMMARY OF FINDINGS. TABLE 12: 

1. More than 50% (the project goal) of children 
showed an accelerated rate of gain in reading, 
Their grade equivalent ranking increased by 

ONE month or more FOR EVERY 20 DAYS PROGRAT'I 
ATTENDANCE. 

ADDITIONAL FINDINGS: To provide a further means of checking 
whether there is a statistically valid superiority 
cimong project children with 10X).or more days attendance, 
over children from the norm group (pretested before 
30 days attendance and therefore showing little or 
no effect from the program) a comparison based on 
average raw scores for each attendance subgroup is 
shown in Table 13 below. 
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TABLE 13 

READING SCORES— COMPARISON OF AVEPAGF. (MEAN) READING SCORES OH 
THE WIDE RANGE ACHIEVEI4ENT TEST BY A€E AlID PERIOD OP 

ATTENDANCE 



Attendance J.n Program 



Age Group Group 100 Days 200 Days 

Under 30 Days Attendance Attendance 



3.0-3.11 


N=13 


2.62 


N=14 


7.38** . - . 


4.0-4.11 


fi=14 


6.29 




10.25* . , >>%^ 


5.0-5.11 




VI. 33 




17. IS**- . . . 


6.0-6.11 


n~H 


17. 7S 




16.13^*^ . . . 



N - nuanfaer in subgroup. 



. . . indicates there were less than sxk cbxlclcen xo 
subgroup so scores were not analyssed. 

** = the superiority of this score over the norm a roup 13 
statistically significant at the ,01 le\fel (rraght be the result ot 
chance less than 1 time in' 100). 

* - the superiority of this score over the notm group xs 
statistically significant at the .05 level {mxqht be the result ot 
chance less than 5 times xn 100) , 

MS = the difference between this score and the norfr^ c^oup 
score is not statistically significant. 



SUffiARY OF FINDINGS, TABLE 13: 

1, The superiority of the THftee- huo rouk-nkR-oof 

CHILDREN WITH PROGffAM £XWieriCe OVEi? TH£ UOm 
GROUP FAR EXCEEDS THE POSSIBILITY THAT THIS DIF- 
FERENCE COULD BE ATTRIBUTED TO CHAr4C£. 

2. The SUPERIORITY of five-year-oljds with rKcmm 

EXPERIENCE OVER THE NORM GROUP IS LARGE, eut 
BECAUSE OF THE SMALL SAMPLE SIZE md THE VARl* 
ASILITY OF INDIVIDUAL SCORES, THIS DlFFfU'lNCe IS 
NOT STATISTICALLY SIGNIFICANT, 
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3. The small difference between average scores of 
the norm group and children with 100 days 
program experience among six'feai^-olds is not 
statistically significant. 



INTEBPBETATIOfJ OF FINDINGS: Reading is the last academic 
area to be introduced in the program so there is 
less than one year of testing in which the subtest 
in reading has been given. At this evaluation, the 
sample size is therefore much smaller for this sub- 
ject area than for the academic areas of math and 
handwriting. There are not enough children in -he 
2p0-day attendance category to evaluate statist icaliy, 
reporting averages of scores in the subgroup. The 
small number of children with 200 days attendance 
was reported for all three academic areas, even where 
it was less than sis, on the tables indicating the 
percentage of children "at or above grade level" 
since this percentage did not involve any averaging. 
In all subject areas, including reading, 100% of the 
scores of children with 200 days attendance was "at 
or above grade level." Likewise in math and in 
spelling the difference between children with program 
experience and those in the norm group was statistically 
significant at the highest level (.01 meaning 1 in 100 
possibility of this difference occurring by chance) . 
It appears that the 200-day attendance period is 
required to firmly establish program benefits. 

CONCLUSION: The majority of children are showing a rate of 
gain in reading which meets project goals. The per- 
centage of children whose actual score gives them a 
grade equivalent ranking at or above that expected for 
their age increases with the length of project atten- 
dance in three out of the four age groups reported, 
and is 100% at all age groups by 200 days attendance. 
The superiority of children with 100 days program 
attendance over the norm group is statistically sig- 
nificant at three and four years of age. Differences 
between children with 100 days attendance and the 
norm group are not statistically significant at five 
and six years of age. 



6. How Well Are Children Learning Cultural Heritage 
Concepts? 



GOAL: Project students demonstrate understanding of cul- 
tural heritage concepts/ as measured by unit mastery 
tests. 

Evaluation Note: Mastery tests based on cultural heritage 

materials developed by the project were not completed 
and initiated into uSe at all sites until January, 
1975. Therefore/ there are no findings on this 
objective which can be reported for this mid-program 
year evaluation. Findings, based on the portion of 
the year these materials have been in use, will be 
reported in the end of the program year evaluation. 



1.0 INSTRUCTIONAL COMPONENT (PROCESS OBJECTIVES) 

1. Does the Rate of Progress Through Academic Curriculum 
Materials Meet Project Goals? 



^GOAL; Teachers will provide instruction using the following 
programmed instructional materials (or substitute 
materials approved by the educational director) at 
a pace whereby at least 50% of the students advance 
by at least one level, or unit, of lessons for every 
days cumulative attendance. 

Singer "Sets and Numbers" math, or project developed 
premath activities. 

Lyons and Carnahan, "Write and See" handwriting (or 
an appropriate substitute as this material is going 
out of print) / and project developed pre-handwriting 
activities. 

Phonics Primer and Sullivan Reading, or project 
developed pre-reading activities. 

ANALYSIS: The evaluation group was defined as those children 
with pre- and post-WRAT tests. A roster of these 
children was developed with their attendance between 
tests indicated in 20-day units, to the nearest unit. 
The difference between their curriculum placement at 
posttest, and at pretest v;as displayed next to the 
ctirriculum units. From this a calculation was made of 
the niiittber and percentage of children who had completed 
at least one curriculum unit per attendance unit in 
math, handwriting (spelling) , and reading. 

CRITERIA FOR ACHIEVEMENT OF PROJECT GOAL: The objective is 
considered to be met if 50% of the children advanced 
by at least one curriculum unit per 20-day attendance 
unit, in each of the programmed curriculum areas. 

FINDINGS: 

TABLE 14 



PROGRESS THROUGH CURRICULUM J!4ATERIALS~NUMBER AND PERCENTAGE OF 
CHILDREN WHO COMPLETED AT LEAST ONE CURRICULUM UNIT FOR EACH 20 

DAYS ATTENDANCE IN PROGRAM 



Subject Area 


No. in 

Eva^.iation 
Group 


No. and % Completing at Meets 
Least One Curriculum Unit Project 
Per 20 Days Attendance Goal? 


Math 


77 


62 (81%) 


Yes 


Handwriting 


42 


29 (69%) 


Yes 


Reading 


68 


39 (57%) 


Yes 
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The number in the evaluation group is different 
because many of the older children have completed 
the handwriting curriculum and some of the youngest ' 
children have hot started reading • 

SUfflARY OF FINDINGS. TABLE 1^1: 

1, The project met its goal in the rate of progress 

BY children through CURRICULUM MATERIALS IN ALL 

three academic areas. 

2. The percentage of- children maintaining a good 

RATE of progress THROUGH CURRICULUM UNITS WAS 
HIGHEST IN MATH. 

CONCLUSION: Presentation of curriculum materials by teachers 
has been at the rate established in the project goals. 
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2. Does The Rate of Progress Through Language Curriculum 
Materials Meet Project Goals? 



GOAL: Teachers will provide concept and language lessons at 
a rate whereby at least 50% of the students will 
advance by at least one level for every 20 days 
cumulative attendance in the pr<3gram. 



Evaluation Note: The programmed language curriculum 

materials were just being phased in during the first 
half of this program year, with all sites using them 
by November/ 1974. Findings on this objective/ 
therefore/ are not available for this mid-program 
year evaluation/ and will be reported in the evalua- 
tion at the end of the, program year. 
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3. -Are Teachers Presenting Cultural Heritage LessoiiIs? 



GOAL: Teachers will provide cultural heritage lessons on at 
least three out of every four weeks of project opera- 
tion. 

ANALYSIS: A roster of teachers was developed followed by the 
weeks during which this particular teacher taught in 
the program. The weeks in which cultural heritage 
lessons were reported was entered and fi^om this the 
number and percentage of teachers offering lessons in 
at least three out of every four weeks was determined. 

CRITERIA FOR ACHIEVEMENT OF PROJECT GOAL: Criterion is 

considered met if 100% of teachers provide lessons at 
a frequency of three out of every four weeks. 

FINDINGS: 

TABLE 15 

CULTURAL HERITAGE LESSONS— NUMBER AND PERCENTAGE OF TEACHERS 
OFFERING CULTURAL HERITAGE LESSONS IN THREE OUT OF EVERY 



FOUR WEEKS THEY TAUGHT 


Number of Teacheirs Number and Percentage 
Providing Lessons for Reporting Cultural 
4 Weeks or More From Heritage Lessons Given 

July-December, 1974 in 3 Out of 4 Weeks 


Meets 
Project 
Goal? 


25 ' 12 (48%) 


No 


SUMMARY OF FINDINGS. TABLE 15: 




1. Only Wo of the project teachers 


REPORTED GIVING 


CULTURAL HERITAGE LESSONS IN THREE OUT OF EVERY 


FOUR WEEKS OF PROGRAM OPERATION/ 


WHICH DOES NOT 


MEET THE PROJECT GOAL. 





INTERPRETATION OF FINDINGS: From site visit information, it 

is clear that much more in the way of cultural heritage 
lessons were offered than is reflected in the above 
findings. The primary problem seems to have been in 
lack of reporting. 

There was also a division by center on this aspect of 
the program. In the year-round center git Moses Lake, 
100% of the teachers met this goal. 
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The project has taken some steps which should improve 
this aspect of the program ♦ One of these has been 
the development of a cultural heritage training unit 
for use in the in-service training program. Another 
has been development of kits for teacher use which 
make the cultural heritage presentations much less 
time consuming In teacher preparation. Another has 
been holding of work'^hops at all sites on cultural 
heritage and how to use the newly developed mastery 
tests for the cultural heritage units during January, 
1975. 

CONCLUSION: Approximately half the project teachers reported 
cultural heritage lessons given in three out of every 
four weeks, which does not meet the project goal. 

A number of steps were reported which have been taken 
to bring the program up to its goals in regard to 
teaching of cultural heritage lessons. 
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• 5.6 

4. Are Teachers Using the Recommended Teaching Methods? 



GOAL: Teachers will use teaching processes as measured by 

classroom observational measures on: 

skills necessary for dual language teaching 
skills necersary for motivating active learning 

with 80% of teachers meeting criterion after three 

months of classroom experience. 

Evaluation Note: The dual language teaching observation 
instrument had to be revised to go with the new 
language curriculum phased into use during the first 
half of this program year. The instrument on moti- 
vating active learning has also been revised. So . 
this objective will be evaluated in the end of pro- 
gram year evaluation based on use of these two revised 
instruments. 
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TABLE 16 

SUMMARY OF INSTRUCTIONAL COMPONENT OBJECTIVES 



Exceeded Met Partially Met Not Met 



Goals for Educational^ 
Outcomes : 


- 








1, Learn preschool 
concepts ' . 


X 




X 




2* Gain in primary 
, ^ .language 


X 




X 




Gain in second 
language 








X 


3. Gain in math skills 


X 




X 




4. Gain in handwriting 


X 




X 


* 

X 


5. Gain in reading 


X 




X 


if 

X 


fl T.^AT"n Pill "hiTfa 1 

concepts 


(To 


be 


evaluated 


end of year) 


f3r>;* 1 Q -poT" Kdiipai" "i nna T 

Processes: 










1. Prescribed pace in 
math , handwr i t ing , 
reading curriculum 


• 

X 




X 




2. Language lesson 
schedule 


(To 


1 

be 


evaluated 


end of year) 


3. Cultural heritage 
lesson schedule 








X 


4. Use of teaching 
processes 


(To 


be 


evaluated 


•kit 

end of year) 



♦Partially met by first grade children. 



**Because of midyear change of materials, or delayed 
development of evaluation instruments. 
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2.0 STAFF DEVELOPMENT COMPONENT 
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1. Have Teachers Mastered Skills Through In-service 
. Training? 



GOAL: Teachers will achieve at least 75% mastery level on 
checklists completing in-service training units. 

ANALYSIS: A roster of teachers is maintained, with the date 
of their initial employment. Throughout the ^year 
in-service -training is continuous. Each training 
unit consists of a series of observations (formally 
recorded) of a teacher on a. given set of teaching 
skills, items on the checklist are marked off as 
^ achieved in formal observations, and when at least 
a 75% score is achieved on a checklist a training 
unit is considered complete. A conference is held, 
which serves as a summary of the teaching skills in 
that unit, after which the checklist is sutaitted to 
the evaluator. The date and score are entered on 
the roster of teachers. 

At the time of evaluation the roster is examined to 
see if each teacher employed two months or longer has 
completed at least one checklist. 

CRITERIA FOR ACHIEVEMENT CP OBJECTIVE: Criterion is considered 
met if every teacher has completed at least one check- 
list at criterion level except teachers employed in^ 
the program less than two months during the evaluation 
period. 

-FINDINGS: For the period July, 1974 through December, 1974 
training took place as indicated on Ta^le 17. 



ERIC 



G4 



i \ 



TABLE 17 
MASTERY OF TRAINING UNITS 
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Center 



^ „ . Number and Percentage « 

J^^S^^f^ .Completing At Least p"^iect 
Employed^ TWO Months checklist At coil? 



Moses Lake 

Connell 

Texas-Mobile 

Total 
Project 



or Longer 



10 
6 
9 



25 



75^ Mastery Level 



5 (50%) 
0 (0%) 

6 (67%) 



11 (44%) 



No 
No 
No 



No 



OF FINDINGS. TABLE 17: 

1. Less than half of the teachers in the program 
completed a training unit during the first half 
of this program year. 



INTERPRETATION OF FINDINGS: The number of checklist comple- 
tions reported for this objective would seem to indi- 
cate a wider variation in the pace of training between 
centers than is actually the case. The training pro- 
cess calls for presentations and formal observations 
to be carried out. The termination of a training unit 
is the checklist. During the first half of this pro- 
gram year the formal observations submitted indicated 
that training was going on at all centers as follows* 
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Moses Lake — 43 iormal observations completed 
(16 checklists) 

Connell-- 34 formal observations completed (no 
checklists) 

Texas Mobile — 34 formal observations completed 
(9 checklists) 

The timing of this evaluation caught a number of 
training units underway but not yet completed at 
Connell. The report is therefore / to this extent/ 
misleading* 
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Overall, however, the training pace has slowed in 
the first half of this program year, as indicated by 
the evaluation findings reported. One problem is 
that the training units developed to go with the new 
curriculum in use in the academic area were too 
massive. Far too many teaching skills were included 
in each one. The result of this was that an initial 
presfentation frequently took five or six training 
sessions to complete, instead of one or two as had 
been the case with earlier training materials 
developed. Similarly, observations would require 
several days because not all items on the observation 
form could be observed and recorded during the length 
of one lesson period. This meant that it was par- 
ticularly difficult to ^complete training in cases 
where training had to be individualized. This would 
be the case with a new teacher who needed material 
other teachers had already completed. And it was 
the case with the mobile program when teachers were 
working in isolated ar^as, and the trainer had to work 
with this one teacher by herself on visits scheduled 
to each site on a rotating basis. The corrective 
action undertaken to deal with this prol^lem has been 
revision of training units, breaking several of them 
into two or three parts to be handled serially. 

Another problem has been that the trainers themselves 
were inadequately prepared to present some of the 
teaching skills and to serve as the on-site model. 
When this was the case, the training had to wait on 
the arrival of a resource trainer who came in for 
periodic visits. Because initial presentations were 
sometimes inadequate for teachers to get a good model 
of what was expected of them, trainers had to do many 
more teaching performance evaluations before teachers 
had mastered the teaching skills to a passing level. ^ 
The corrective action that has been undertaken on this 
problem is scheduling trainer-training conferences on 
the different training units. The project is also 
having the resource trainer concentrate attention on 
upgrading the skills of the on-site trainers, instead 
of doing so much observation and training directly 
with the teachers. In the long run this will result 
in a more efficient training program. 

CONCLUSION: During the first half of this program year, the 
rate of completion of in-service training has fallen 
considerably below the project goal. Corrective actions 
are underway which should do much to improve the record 
by the final evaluation for this program year. 
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2. Are Teachers Continuing Academic Training? 
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GOAL: At least 80% of project staff will be enrolled for 

high school CiED courses, or college courses, to fur- 
ther their academic training. 

ANALYSIS: A roster of full-time staff is used with a check- 
off procedure denoting enrollment in college classes, 
or in GED classes. This is maintained by the pro- 
ject manager and provided at evaluation dates to the 
evaluator by memo. 

CRITERIA FOR ACHIEVEMENT OF GOAL: The objective is con- 
sidered met if at least 80% of full-time staff is 
enrolled for academic training during the evaluation 
period. 

FINDINGS: TaMe 18, below, reports the number of full-time 
staff who were employed at the start of the fall 
quarter, September, 1974, and the number who enrolled 
in college courses or high school GED training during 
the fall. 

TABLE 18 

FULL-TIME STAFF ENROLLED IN COLLEGE COURSES OR HIGH SCHOOL GED 
CLASSES, SEPTEMBER-DECEMBER, 1974 



Staff Category 



Total Enrolled , 
in 

College Courses 



Enrolled 
in GED 



Not Enrolled 
in Academic 
Courses 



Educ. Director 
Trainers 

Site Coordinators 

Secretaries 

Teachers 

Total Project 



2 
1 

1 
16 



1 
2 
i 
1 
0 



(Has M.A.) 
(Have B.A.) 



20 



Percentage of total full-time staff 
enrolled in continuing academic work; 



81' 



SUMMARY OF FlfiDINGS, TABLE 18: 

1. Of the teachers in the project^ 1007a were continu- 
ing their academic training through either GED 

WORK OR COLLEGE COURSES. 
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2, Of the total full-time staff, Zll were conTirwuiG 

ACADEMIC COURSES DURING THE FALL SEfCSTER/ WHICH 
MEETS THE PROJECT GOAL OF AT LEAST 80%. 



CONCLUSION: The program, again this tall, met its goal toe 
staff improvejtient through contmutwi acadeifiic train- 
ing, with 81% of full -time &ta,ii er.roU^ed m coileg'- 
or GED classes. 
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STAFF UEV£LOP[€NT mPONEflJ (PROCESS OBJECTIVES) 

hU Does The Pace Of TRAi^niG Meet Project Objectives? 



GOAL: Teacher trainers will provide in-service tr§j.ning at 
a rate which will enable 80% of the teachers to com- 
plete a training unit for every two months of active 
employment . 

mpsLYSlSn A roster of teachers with the"^momth-of, their 

emplo^TOent is maintained. The months of active^-^ploy- 
ment daring the evaluation are determined from this. 
A training unit is noted by date of completion. A 
plus or minus designation indicates whether individual 
teachers have completed the required number of train- 
ing units for the months they have worked. From this 
the percentage of teachers who have met the^ training 
criteria is determined. ^ 

CBVVBRIA FOR ACHIEVEMENT OF PROJECT GOAL: The criterion is 
considered met if 80% of teachers complete a training 
unit for every two months active employment. 

FlUDiUGSt Table 19 below indicates the number of teachers who 
I completed at least one training unit for each two months 

^ of employment. 

TABLE ' 1 9 



TUsClilRS mo COMPLETED TR/aHIUG UHITS 



Nujtib.^.r of Teacher^* Number and Percentage Me^t-s 

Ltr^ployed Tv,'o Months Who Completed at Least pj^oject 

or Longer One Training Unit Per Goal^' 

July-^Decen^ber . 1974 Two Months Emplbyment 



SUMf'IARY OF FINDINGS. TABLE 19: 

1. Of the teachers employed two months or longer 
BETWEEN July and "December/ 197^1/ six. or 25%. 
completed in-service training at the rate of 

AT LEAST one UNIT EVERY TWO MONTHS. 

INTERPRETATION OF FINDINGS: The reader is referred to the 
earlier discussion of problems in the training area, 
and corrections being undertaken to bring training 
up to the pace the program expects. 

CONCLUSION: During the first half of this program year, the 
pace of training fell considerably below the project's 
goal. 
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2. Is The Project Helping Staff Continue Their Academic 
Education? 



GOAL: Administrative staff will arrange academic training 
opportunities for staff, and provide counseling to 
encourage staff to continue their academic training, 

ANALYSIS: The documentation of this objective consists of 
memos from the project manager concerning efforts 
directed toward obtaining appropriate academic 
opportxinities . 

CRITERIA FOR ACHIEVEMENT OF GOAL: Examination of the evi- 
dence provided of how the above activities were 
carried out. 

FINDINGS: The project had people working at three levels 
of academic work during the fall of 1974. 

Graduate : Imelda Guerra, trainer, through Antioch 
College completed a master's degree program. This 
was arranged entirely by field work (e.g., no on-campus 
courses required) . Project staff assisted her in this 
work providing background and guidance on coiirses she 
completed in educational administration, curriculum, 
and evaluation. 

Undergraduate : Each quarter, all teachers have been 
enrolled in college courses. These are taken through 
Columbia Basin Community College. The selection of 
courses, and overseeing of enrollment requirements, 
filing of grades, etc., is handled by the project 
manager. Courses are selected to coincide with in- 
service training units, but require additional work 
by teachers as well. Resource materials are $ent out 
by the project manager. All classes are completed on 
a field work basis (e.g., no on-campus classes required). 
This past summer several teachers completed one year 
(45 credit hours) of work. 

High School GED : The program has attempted to enroll 
staff who need their GED in courses offered to the 
public by other agencies. As these classes had not 
been available for two staff members who needed the 
GED, special tutoring was arranged at the center. 
Classes are held twice a week after work. 

The project manager also investigated an undergraduate 
program through Antioch College which may be utilized 
(again on a field work basis) by staff who have 
credits beyond the limits of the community college, 
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but still do not have their B.A, degree • One staff 
member is considering ythis but none have as yet 
enrolled. / 

CONCLUSION: The project has devoted staff time to arranging ^ 
appropriate academic opportunities through which 
employees may improve their skills/ and has fully met 
the project objective. 

TABLE 20 

SUIvlMARY OF STAFF DEVELOPMENT COMPONENT OBJECTIVES 

Exceeded Met Partially Met Not Met 

Outcome objectives: 

1. Mastery of in- ^ -^^^ ^ 
service training ^-"^^"^ 

unit(s) X X 

2. Staff continues 

academic studies X 

Process objectives: 

1. Maintaining pace 
of in-service 

training X X 

2* Arranging continu- 
ing academic train- 
ing X X 
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PARENT AND COmUNITY INVOLVEMENT COMPONENT 
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1. Are Family Members Participating in Children's 
Educational Program? 



GOAL: Family members equal to at least one-third the 

^enrollment capacity at each site will participate 
in their children's educational program through 
(a) home teaching program, or (b) center instructional 
program, or (c) assisting with cultural heritage 
activities. 

ANALYSIS: A roster is made up of parents employed in 

insl^ructional program by site, and of parents par- 
ticipating in any of the three ways itemized above 
by site, at least up to the number required to deter- 
mine that one-third the enrollment capacity of each 
center has participated. 

CRITERIA FOR ACHIEVEMENT OF GOAL: Examination of roster 

above described to confirm that family members par- 
ticipating in the educational program in one of the 
three ways is at least equal to one-third the enroll- 
ment capacity at each site. 

FINDINGS: Table 21 below summarizes the participation of 
family members related to enrolled children in edu- 
cational activities for the children. Family members 
are not restricted to parents, but include any per- 
son who might be in the child's extended family; 
e.g., brother, sister, aunts, uncles, grandparents, 
etc., as well as parents. In the cultural background 
of the majority of children enrolled, the family 
relating to these children is an extended family, 
not just the nuclear family. 
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TABLE 21 
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PARTICIPATION BY FAMILY MEMBERS IN CHILDREN'S EDUCATIONAL 
ACTIVITIES DURING PERIOD JULY-DECEMBER, 1974 



Site 


Number of Family 
Members Partici— 
pating in Educa- 
tional Program 


Percentage of 
Enrollment Capa- 
city of Center 


Meets 
Goal? 


Moses Lake, WA 


25, 


56% 


Yes 


Connell, WA 


15 


42% 


Yes 


Grulla/ Texas 
and mobile 
sites 


9 


12% 


No 



Note: Enrollment capacity of centers is larger than in 
previous evaluations because it now includes the school-age 
component. 

SUGARY OF FINDINGS. TABLE 21: 

1. The percentage of family members participating 

IN educational ACTIVITIES AT MoSES LaKE IS 56%/ 

nearly double the minimum goal. 

2. The percentage of family members participating ^in 
educational activities at connell is a2%/ which 
meets and exceeds project goals. 

5. In GrullA/ Texas and at the mobile siteS/ par- 
ticipation DURING THE FIRST HALF OF THE PROGRAM 
YEAR WAS MUCH LESS THAN AT THE OTHER TWO SITES/ 
APPROXIMATELY 12% OF ENROLLMENT CAPACITY AND BELOW 
THE GOAL, 

INTERPRETATION OF FINDINGS: The project has enjoyed the ser- 
vices of a site coordinator stationed at Moses Lake, 
who works extremely hard at parent and family partici- 
pation. The finding that this type of participation 
at Moses Lake far exceeds minimum goals is consistent 
with the past several evaluations. The trainer at 
Connell has major responsibility for outreach service 
in the past, but this fall has been assisted to some 
extent by the site coordinator who is now working 



full-time between the two sites* The amount of parent 
participation in educational activities at Connell is 
somewhat higher than past evaluations (the goal is also 
higher as the enrollment has increased) • 

The responsibility of the site coordinator for the 
Texas and mobile sites has in the past concentrated 
in the area of facilities, supplies, and recruitment. 
This program, even in Texas, is a great distance from 
shopping centers (the nearest one a 34-mile round trip) 
And considering that it moves and sets up again six 
to eight times in a year^-^ch move requiring work on 
the facility, new recruitment, establishing of lines 
of credit, locating of equipment, etc. — the attention 
to these needs has taken precedence over outreach to 
bring parents into the center for the educational 
program. 

Since January, 1975, a new program for the involvement 
of parents has been undertaken at all sites, which is 
largely under the direction of the trainers with 
assistance by the site coordinator and educational 
director. This program is called "family fun nights" 
and involves parents in educational games with the 
children at the center. Because of this program, it 
is expected that the quota of participation by family 
members at all sites will have met the project goals 
by the end-of-the-year evaluation. 

ONCLOSION: The project has met its goal for involvement of 
parents in educational activities for their children 
in the two Washington state permanent sites. The goal 
was not met during the first half of the program year 
in the Texas-mobile component. 
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2. How Have Families Participated in Program Management? 



GOAL: Parents and community advisory groups will be active 
in program management decisions involving (a) organi- 
zational matters (voting for officers, meeting times, 
parent group activities, etc.); (b) review of pro- 
posals or work program changes; (c) personnel actions; 
(d) use of parent funds; (e) discussion of educational 
program and evaluations of progress. 

ANALYSIS: Analysis for this objective involves examining the 
content of the minutes of parent-community advisory 
group meetings site by site, and classifying actions 
taken which fall into the categories listed above. 

CRITERIA FOR ACHIEVEMENT OF GOAL: The objective is considered 
to have been met if * meeting minutes from every site 
confirm action of the parent and community advisory 
group in at least four out of the five specified 
areas. 

FINDINGS: A content analysis of the minutes of parent- 
community advisory group meetings from each site, 
for the period of July, 1974 through December, 1974 
classified actions into the five categories shown in 
Table 22. 



TABLE 22 

CONTENT ANALYSIS OF PARENT-COMMUNITY ADVISORY GROUP MINUTES 



Grulla 



Connell 



Moses Lake 



(a) Organizational Matters (and Parent Activities) 



10/74 Replace board 
member 

12/74 Plan to make 
lawyer available 



7/74 Setting meeting 10/74 Elect officers 
time 

11/74 Project to make 
11/74 Discuss how aprons; Thanksgiving 
parent group could dinner for staff 
operate with con- 
sultant 



(b) Review of Funding Proposals, ^Program Changes 



10/74 Discuss plans None reported (no 

for school-age new proposals 

tutoring; new pro- developed during 

gram this time period) 



10/74 Review funding 
sources with project 
manager, discuss pro- 
posal planning 
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TABLE 22. —Continued 
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Grulla 



Connell 



Moses Lake 



(c) Personnel Actions 



10/74 Discuss hiring 
of two teachers; one 
employee probation 



None reported. None 10/74 Screen applicants, 
needed — one teacher fill three positions 
resigned but was re- (teachers and tester) 
placed by teacher 
reassigned from Moses 
Lake 



(d) Use of Parent Funds 



12/74 Plan to start 
building center next 
year with $4,000 in, 
parent fund 



7/74 Discuss how to 
earn parent funds 



9/74 Discuss use of 
parent funds; how to 
earn 

10/74 Plan spend $400 

for kitchen supplies 10/74 Agree to buy $35 
and children's toys worth of beans; 
for exchange activi- Christmas gifts for 
ties; committee to children 
shop appointed / 

12/74 Agree to two loans 
from parent fund/money 


(e) Discussion of the Educational Program, and Evaluations 

of Progress 



8/74 Discuss hours 
of operation; demon- 
stration of methods 
and materials given 

9/74 Date to close 
Prosser center, how 
handle bussing next 
year*^ Parents eval- 
uation of program; 
appreciation to 
teachers 

10/74 Discuss par- 
ent evenings and 
extending tutoring 
to first grade 



7/74 Discuss how to 
involve fathers 

8/74 Discuss fiesta 
for cultural heri- 
tage program 

10/74 Discuss home 
teaching program 



10/74 Planning parent 
participation in open 
house 

11/74 Parents plan 
evening educational 
program with children 



11/74 Discuss use of 
positive reinforce- 
ment teaching 
methods used, endorsed 
by parents 
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SUMMARY OF FINDINGS. TABLE 22; 

1. The Parent-Community Advisory Groups have been 
active at all sites/ making decisions on personnel. 

program, use of funds. AND A VARIETY OF OTHER 
RELATED ACTIVITIES OUTLINED ABOVE. 

CONCLUSION: The project has met its goal of active parent 
participation in program decision making. 



\ 



ERIC 



3.0 PARENT AND COMMUNITY INVOLVEMENT COMPONENT 
PROCESS OBJECTIVES 
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1. Has Staff Solicited Parental Involvement? 



GOAL: Project staff will solicit participation of parents 
in the children ^s educational prograin^ 

ANALYSIS: Examination of weekly reports submitted by pro- 
ject staff, minutes of meetings of parent advisory 
groups, and other memos regarding staff efforts to 
involve parents. 

CRITERIA FOR ACHIEVEMENT OF GOAL: Judgment by the evalu- 
ator that significant efforts have been made to 
involve parents at each site based on documents men- 
tioned above. 

FINDINGS: Minutes from each site indicate repeated dis- 
cussions of how parents may participate in the educa- 
tional program. Site coordinator reports indicate 
parent contacts weekly. Natalie Rodriguez, a 
special consultant on parental involvement, assisted 
the parent groups at Connell and at Moses Lake plan 
how to increase involvement and means of organizing 
for effective action. Materials were developed and 
reproduced^ for parents to indicate how parents may 
work with their children at home or in the special 
"family fun night" programs initiated this year. 

CONCLUSION: Staff at all sites have solicited parental 
involvement, in keeping with project objectives. 
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2. Does Staff Report Regularly to Parent Management 
Groups? 



GOAL: Project staff will provide parent-advisory groups with 
the information needed to participate in program deci- 
sions by submission for review project proposals and 
evaluation reports, and by attendance regularly at 
parent advisory group meetings* 

ANALYSIS: Listing of proposals prepared and evaluations 
issued for each evaluation period* Notations of 
materials for review. List of parent community 
advisory group meetings held for each site* Nota- 
tion next to each of staff attending. 

CRITERIA FOR DETERMINING ACHIEVEMENT OF GOAL; The Objective 
is considered met if there is evidence of parent 
involvement in reviewing of every proposal and evalu- 
ation, and if at least some of the on-site staff 
attended each parent and community advisory group 
meeting held during the evaluation period. 

FINDINGS: No proposals are developed during the July- 
December period. This objective will therefore be 
reported in the end-of-program-year evaluation in 
July, 1975. 

Each of the evaluation reports issued during this 
period has been suhxnitted to the president or chairman 
of the parent-community advisory group for each site 
as documented by covering letters. 

Minutes of monthly meetings (plus special committee 
meetings) from sites indicate staff present at each 
parent community advisory meeting. 

CONCLUSION: Staff has, provided parent groups with written 
evaluations and with oral reports and opportunities 
to review the program operations, from which basis they 
have been able to participate fully in program deci- 
sion making. 
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TABLE 23 

SUMiMARY OF PARKNTAL XWOLVFMENT COMPONENT OBJECTIVES 



Exceeded Met Partially Met Mot Met 



Outcome objectives: > 

1. Parents participate 
in their children's 
educati<Jn^ X X 

2» Parents participate 
in management of the 
project X 

Process objectives: 

1. Staff will solicit/ 

parental involvemefnt X 

2. Staff reports to 

parent group X 



^.0 HATERIALS OEVELOPrlEriT LOHPGiCIlT 



GOAL: Project manager purchc*be:: c-r puMisruc-i' j^'rc-^r xn-utcca 

curriculuxri materials in conccj:'t-L:*f»qua9^? developn^cn* 
area. {PR^XESS GOALl Educationoi director ..^^nd other 
staff assigned by hm vif^xt sxt^^s using p4^»>5t^:4jrr.jTic^i 
camculum mater lala m ccmcept/ l^nqu^u)*:: developm^^^ 
area and selects frate<ji;il£ fo^r project 

STATUS REPOF,Ti The Educatxcn^l Cm tec tor, his two triur^^t:. 
from the Texas site^ th*- t'ist»i:r^ >r;d hji? ev^:^luvito^ 
vxsxted U«/ald*": , Te;»;v^s Fol low Through project 
March» 1974 to observe the it ) aoqui^qo ot: veiopirtefvt- 
curriculum^ (Th^* vi^^:tt vas pteccd»^>'^ by j.min:tt >om 
of research reports on thxs cur^r^^^ulunj i^uid tt: 
ef f ect iv^£^a»c/ss ♦ cuid son'ie :xm.i^<t ion rvf '-/ne nviiti-^ / x j » - 

The rducationaX Oxroct'^r '^oci^J»i^i t*. j'ioy . thif c«>r- 
nculsxm and not xt xevi' t project rron-joer co oraoi 
thent, English l<<na»ia9e toa tf-r :* I s wexe v^^xchM^e'^ 
Spanish l^o^juage roater 1 , xnx^ialiy, pro^'3Loli 
us by the Uvalde proTect- ( which hc/n obtjAV^O':^ ^h'l.^^ 
from >^ast Las"' Vegai , tUi*^ iMo,- i-: ^^fv:] iAor»- 
copyr jit.^ hted motor xa l i -'.'cc ^:M^^^ OT^s.^ccri fh^ o^--' - 



FsC 1 3 1 >;-d roa t c <: \ a Is 1' ^ * . ^ J i-o r* • ^ : I ^^-p.^ r,o jt:'Mj ^ 

Ixshed by the project . l ^c'n - 'i wuec '.o^'k lc^^>kUi jf < 

'i s a n > c h x e v e f' > e a t t < . : t V v «: 1 1 ^ I r . n c t ,^ 1 e ' * . 

wh jkt t he y h ^ \' ; st nr . 3 t' y s n :« >„a ^ - j u < * t- c t e- ^ r ' 

teacher thcrt o}ftL% 5:ne rc.vuitr t:^, ? ■ o-v .irp-j r.^^L-*:*^ ' 

Cuaccpts trtL chxld 0'j>-'":. n^.^i \ t.^y^ . h;j r.:iH^-^- rv^ .-.m 

^ ' / o J c t r» -5 p u C' ' i r h e»J £ ♦ ] ^ > f'; m m ■? i u * < * ^ 1^ \ r. 

r ij c t J n <:i I > " b 1 1 -T< he J 

In C'C>;ier ^^')f: ^ /rr*: ~ \^ 1 w W < ."1 3 ' ' . ^ 

X' h X c h t he i> c h ). '/o f UT-' n I . <^ ho o j x w 0 ' m ■ , 

under zA i^no \ n<i -xi ^ 0/ h > r t - '^0 h^, >-,. or :-r » ^ , , 

C h X ici jii K - J ' 'M . ^ < .-^^ ; f . 

1 1 '"^ . - It ' « " ; 5 ' ' 1 u « ' . h ' , ' > ! ! / - 

5 r, , . i -1 I t' ; , . fi ^ '^'.^ - 1 > * • ' < o., r ) . . ' V ' ^ ' - ' . . 
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tv incluc^c the for?r^4it v;e fee J v/as iP^pDirtant to learri- 
XA*^ the concepts, and to u&e the Spanish words more 
i?.c*ii\x<xt to our tatqet group of children. (The Mew 
^*^?c;vxco Sp^^nxsh'^ in gerier»i<l, derives from descendants 
ot Spanish iiWijt grants? the Spanish of Ofor children 
tforn imnxqr^^nts from Me;*: ico-^-* hence the word differ- 

iSJOi'i; Staft h^ive car tied out the search and selection 
proce::*s for iangyage-concept de^relopment curriculum 

m the '3oalw Materials have been published or 
pu-r.chosed and been pat intvO use at all sites. The 
development of ancillary rsn^terials (testing instruments) 
ro-^< al^^o been carried out. Revision of the materials 
tc> idapt them to our target gcoap is underway. 
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I 2. Pre-Academic Activities in Math. Handwriting, and 

! READING. 



GOAL: Evaluator publishes curriculum tracking system for 
pre^-academic activities in math, handv/riting, and 
reading areas • 

PROCESS dOAL: Curriculum resource trainer organized 
pre-acad^mic activities into a sequential series from 
which the evaluator can develop a report system for 
tracking progress for children not yet into the pro- 
grammed curriculum academic subject materials. 

STATUS REPORT: The ppe-academic material in math was developed 
by trainer/ I?r/elda Guerra/ as one part of the work 
toward her Master's Degree (as reported in the staff 
development component). She was assisted by the^ 
evaluator and curriculum resource trainer in defining 
the sequence of skills children needed. 

The lowest level of the published math materials the 
prograiri uses presumes the child has many skills; 
skill to circle objects / connect sets with lines / 
make in boxes. It presumes he knows how to count 
and recnqnize numerals. These are the "pre-academic" 
skills needed in math. Imelda developed a series of 
activities into a 92-page book. This includes identi- 
fication of real objects to be used, procedures to be 
followed, and dialogue of the teacher. It also 
includes a mastery test by which the teacher can 
determine if the child is ready to go on. The skills 
are sequenced and programmed, and they tie in to the 
published materials wa are using (going back and forth 
to provide children skills the published materials 
leave out ) . 

These materials have been field tested at the Texas site 
this winter. They have not yet been put into use at 
all sites, and tne curriculum repotting and tracking 
system needs still to tje developed by the evaluator. 
In addition, the project needs to develop and publish 
an achie>/ement test to go with these pre-academic 
skills which can be used by the tester to provide con-^ 
firm^^tioA of the teacher testing that children have 
leeirned certain skills and concepts and are ready to 
proorcss. 
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In handwriting, the curriculum resource trainer 
developed some materials with an easier level of 
skills to precede work in the University of Kansas 
developed materials we have purchased. These are 
used as supplementary materials at present, as the 
project is looking for a replacement of the entire 
handwriting curriculum (the Write and See materials 
have gone out of print) . The resource trainer and 
Educational Director are now examining another series 
(several were examined and rejected already) • Some- 
thing new will be adopted this Spring* 

In reading, rather than developing pre-academic 
material, the introduction of children to the reading 
curriculum is simply postponed. 

CONCLUSION: Pre-academic materials in math have been developed, 
are being field tested, and will need development of 
placement and achievement test instruments as well as 
the reporting and tracking system. 

Supplementary materials for pre-academic skills are 
in use for handwriting, but no additional work to 
tie these in with the curriculum materials in use is 
being made because the entire handwriting curriculum 
may be replaced since existing materials are now out 
of print. 

Pre-academic work in reading will not be developed, 
as the project decided that it was more appropriate 
to postpone introduction of reading until children 
were older. 
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3. Cultural Heritage Test Instruments. 



GOAL: Evaluator publishes master tests for cultural heritage 
curriculum units, 

PROCESS GOAL: Training staff develops mastery tests 
to accompany project developed cultura^l heritage 
curriculum lessons for use by program Waluator in n 
place of current test of cultural knowledge. 

STATUS REPORT: The two Washington State staff trainers 

developed mastery tests for 14 of the Mexican cultural 
heritage units developed by former staff member, 
Teresa Cruz. 

In addition, materials developers have produced ten 
new cultural heritage units, with accompanying mastery 
tests, which add U/iited States and other nation's 
cultural heritage units to our curriculiim, so it is, 
by now, more "multi-cultural" than bicultural. 

The project manager has reproduced testing notebooks 
for each teacher, as these are teacher given. A 
report system has been worked out. Workshops were 
held at all sites during January to train teachers in. 
the test usage, and beginning February 1, 1975 the 
testing program is being fully implemented. 

CONCLUSION: This objective has been fully carried out, 
materials published and put into use. 

EVALUATOR NOTE: Some of the project funding for the school- 
age children comes from Washington State URRD grants. , 
y New regulations published by URRD indicate that an 
y expected program outcome for bicultural projects in 
the future will include: 

"75% of participating students enrolled for 
six months or more will show statistically 
significant increases in awareness of the cul- 
ture of the dominant participating population 
as measured by a test of significance between 
means on pre- and post-tests of instruments 
deemed appropriate by project staff and 4he 
state Superintendent of Public Instruction." 

The State Office of the Superintendent has not indi-^ 
cated any tests which they recommend using. If the 
tests developed by this project are used, they will 
have to be used in a different v/ay. At present, they ' 
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are used only as a posttest to measure mastery after 
presentation of material. We would have to devise a 
procedure for pretesting- The scoring system would 
have to be adapted to enable this type of statistical 
comparison. 

It seems possible that the above regulation assumes 
the existence of test instruments that are not^ in 
fact, available and that the regulation will be modi- 
fied. If not, additional materials development in 
this area will be required. 
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^, Publishing Dissemination Information. 



GOAL: Project Manager publishes or submits for publication 
dissemination materials on project's methods and 
accomplishments . 

PROCESS GOAL: The program manager or evaluator writes 
or prepares materials for publication related to pro- 
gram objectives, approaches, and accomplishments. 

STATUS REPORT: The Project Manager invited in photographers 
and reporters to the ceremonies at which project staff 
were presented their one-year certificates from 
Columbia Basin Community College. She also provided 
them with information on the project, and the training 
program through which this college work was done. This 
resulted in a series of articles in newspapers in 
the Yakima Valley, Columbia Basin area, and in Texas. 

CONCLUSION: The project has disseminated iiiformation via 
newspapers on the project. ! ^ 

EVALUATOR NOTE: The project was reported by the United 
States Office of Education as a "Demonstrator- 
Dissemination" Model earlier this year. Since that 
time we have been flooded with requests for informa- 
tion on various aspects of the program, by phone and 
mail. We have not had the staff to respond to these 
requests, nor to develop material appropriate to the 
type of requests that have been received. If the 
pace of this type of request continues it will require 
some program adjustment to fulfill the responsibility 
we have as a demonstration program. 
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5^ Publishing "Take Home" Materials for Parents To Use 
With Their Children In Each Subject Area. 



GOAL: Project Manager publishes "take home" materials for 
parents to use with their children in each subject 
area, 

PROCESS GOALS The curriculum resource trainer 
selects or adapts workbook pages from programmed 
curriculum materials to reproduce for "take home" 
materials. 

STATUS REPORT: The curriculum resource trainer and evalua- 
tor have met twice on this objective. The number of 
units to be developed has been determined (one per 
level) in math and in reading* Some work has been 
done on the format. However, most of the work on 
this objective remains to be carried out in the 
coming months. 

CONCLUSION: The development of material is underway, but 
not complete. Nothing has been published yet. 
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6,^Fbedback Forms and System for Review of Curriculum, 



GOAL: Evaluator publishes a form for recording feedback on 

curriculum use for review of new language/concept area 
materials, and pre-academic activities. 

STATUS REPORT: Achievement tests have been developed in 

the language/concept area, and in math and reading. 
These enable information based on child performance 
of where teaching is weak. The evaluator has developed 
a system for reviewing these data , giving them to the 
center staff (teacher and trainer) and to training 
consultants who work at a dual level — suggesting 
appropriate remediation for individual children, and 
suggesting methods of helping the teacher do a more 
adequate job of getting the concepts across. A feed- 
back loop is developed whereby remediation efforts are 
reported by the teacher, and performance re-evaluated 
on another round of testing. 



CONCLUSION: This feedback system is in operationxLn refer- 
ence to the new language/concept area materials; also 
to math and reading curriculum. It has yet to be 
extended to the pre-academic math materials. 



This needs to be extended to the pre-academic cur- 
riculum materials within the next few months. 
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7. Staff Training Materials Published. 



GOAL: Project Manager publishes at least six new units of 
staff training materials for use in the in-service 
training ' program . 

PROCESS GOAL: Consultants or project staff will write 
at least six new units of staff training materials for 
use in the in-service training program. 

STATUS REPORT: New training units developed thus far this 
program year include the following topics: 

1. Cultural heritage. 

2. Teaching the Primer: Using signals and main- 
taining attention. 

3« Teaching the Primer: Teaching sequences (initial 
and correction) . 

4. Teaching the Primer: Testing / planning ^ and 
remediation* 

5. Teaching Sullivan Reading: Teaching sequences. 

6. Teaching Sullivan Reading: Planning ^ grouping ^ 
remediation. 

7. Using positive reinforcement. 

8. Use of the number line: Teaching simple addition. 

9. Use of the number line: Teaching missing addend. 
10. Use of the number line: Teaching simple subtracting, 

Each of the above includes discussion training 
materials / a formal observation instrument, and a 
checklist for final evaluation of teaching performance. 

CONCLUSION: The project has exceeded its goal in development 
of new training units. 
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TABLE 24 

SUMMARY OF MATERIALS DEVELOPMENT COMPONENT OBJECTIVES 
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Exceeded Met Partially Met Not Met 



Outcome objectiTAres : 

1. Purchase or publish 
concept- language 

development curriculum X 

2. Publish curriculum and 
tracking system for 
pre-academic activ^i- 

ties X X""" 

3. Mastery tests published 
for Mexican cultural ^ 
heritage activities X X 

4. Publish newspaper 

articles X 

5. Publish "take home" 

material for parent use jp 

6. Feedback system on 
language and pre- . 

academic curriculum X X X 

1. Publish six units of 
teacher training 

materials X X 

Process objectives: 

1. Site visits to 
examine language 

curriculum X 

2. Sequence pre-academic 

activities X X 

3. Develop mastery tests 

for cultural heritage X 

4. Write articles X 

5. Develop "take home" 

materials X 

6. Write six units of 
teacher training 

materials X X 



Met in math; objective changed in regard to handwriting 
and reading-* 
2 

Mastery tests also developed for new multi-cultural activities. 

3 

Not due yet — publication will be on schedule. 

4 

Feedback system also extended to math and reading. 
5 Q ' 

9ir>" Feedback system not developed for pre-academic math ^^'^ 

hlylC materials yet. 
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5.0 MANAGEMENT COMPONENT FOR INTERSTATE DELIVERY SYSTEM 



1. How Well Is The Program Able To Follow Children As 
They Move? 



GOAL: At least 7 0% of the children enrolled in Texas during 
the winter of 1973-74 will be served again in one or 
more northern locations through implementation of a 
relocating delivery system, 

ANALYSIS: A roster is made up of all children enrolled dur- 
ing the home base phase of the program during the 
winter of 1973-74. During the April through October 
months of mobile program operations, a checkoff of 
each additional enrollment in ofte of the mobile sites 
is made. From this the number and percentage are 
then calculated of children who were served in Texas 
and again in one or .more northern locations. 

CRITERIA FOR ACHIEVEMENT OF GOAL: The objective is considered 
to have been met if the percentage served in one or 
more northern locations represents at least 70% of 
those served in Texas during the winter 1973-74. 

FINDINGS: Table 25 below shows the continuity rate achieved 
by the program for the past three years. 



TABLE 25 

PERCENTAGE OF CHILDREN SERVED IN^-^^IW^OR MORE 
LOCATIONS BY MOBILE PROGRAMS 



Number and Percentage 
. ^ Number of Children of Children Served at 

Served at Home Base Home Base and Again m 

One or More Instream 



Sites 



1971- 


-72 


78 


56 


(72%) 


1972- 


-73 , 


77 


57 


(74%) 


1973- 


-74 


76 


46 


(61%) 
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SUMMARY OF FINDINGS. TABLE 25: 

1. The mobile project served 61% of the children 

ENROLLED IN TeXAS DURING THE WINTER OF 1973-7^1 
IN ONE OR MORE NORTHERN LOCATIONS, ThIS IS 
SHORT OF THE PROJECT GOAL OF 70%. BASED ON CON- 
TINUITY ACHIEVED IN THE FIRST TWO YEARS OF PRO- 
JECT OPERATION. 

INTERPRETATION OF FINDINGS: Two teachers resigned just 
before the northern phase last summer because of 
family circumstances beyond their control. This 
left the project without staff for two areas we have 
previously served with the mobile .program , and a 
number of children moving to these areas were left 
out. Because of the need to train teachers before 
asking them to offer educational services in isolated 
areas where they have very little support from pro- 
fessional staff, it is difficult to replace staff 
during the northern phase. 

During the first year of program operations', the pro- 
ject design called for training of two teachers as 
substitutes who would work in the Texas centers, but 
not^ be assigned as regular staff for the program in 
the mobile phase unless needed as a substitute. 
Reduced funding eliminated this possibility in the 
following two years. During the winter of 1974-7 5, 
money obtained from manpower funds has again enabled 
the program to put on some staff during the winter 
program to be trained who may or may , not be used in 
the north, but are available as replacements. It is 
expected that the continuity of service to children 
will again improve because of this back-up staff. 

Although the continuity of service to children during 
the northern phase fell below the project's goal of 
70%, this figure should be considered in perspective 
against the 19% which is the highest continuity rate 
achieved by other programs which have attempted to 
follow children on the move. (See October 1972 
evaluation report.) 

CONCLUSION: The project achieved 61?> continuity of service 
to children in two or more sites instead of the 70% 
set as a goal. 
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2. How Well Has the Project Coordinated With Other 
Educational Agencies In Host Communities? 
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GOAL: Tiie Program Manager, Educational Director ^ or Site 

Coordinators will coordinate services with educational 
agencies in each host community. 

ANALYSIS: The Educational Director submits information on his 
contacts with other agencies on a periodic basis for 
the Project Manager. She maintains a running file on 
her coordinative contacts with other agencies. 

Each Site Coordinator submits weekly reports on his 
coordinative contacts with other agencies (as well as 
with parents) to the Project Manager. 

At evaluation time the Project Manager provides a 
summary of these contacts foir each site to the project 
evaluator. From this a determination is made of 
whether the project has coordinated with other educa- 
tional agencies in each ''host" community to which the 
mobile program moves, 

CRITERIA FOR DETERMINING ACHIEVEMEOT OF GOAL: The criterion 
was met if there are coordinative contacts with edu-- 
cational agencies (either public school or preschool) 
in each host community. 

FINDINGS: The listing below identifies and describes the 

coordinative contacts made in each host coironunity to 
which the mobile program moved, for the first half of 
this program year. 

PASCO, WASHINGTON ; The public school offert^^^ a program* 
for school-age migrant children during the c»uiTorner« 
Staff contacted the principal, and worked out an 
arrangement whereby teachers from our program used 
space in the school to continue to work with our chil- 
dren enrolled in that program. 

Preschool children attended a center sponsored by the 
Educational Institute for Rural Families, in Pasco. 
This was an agency funded to provide short-term day 
care services to prt3school migrant children who could 
not be accommodated in y^^ar -round day care centers 
operating in the area. Our staff helped provide theirs 
with curriculum materials and training . Our teacher 
worked in their center^ with time free to continu,e our 
special educational curriculurrf with La Grulia children. 

VfYien both these programs closed^ our pcograrr? continue^i 
to operate in a trailer provided by Gteen Giant Corpora- 
tion at the farpi labor camp housing most of the fomDies 
^ from our mobile program • 
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«-t^e COFKi^^Tj^/nr d not ''-y-rjt*- ^ r, ^ m - <^cs, 

wore croJti* wxth ^t^n^'xp*! ^j? i" I «' n-h: nt c ^' 'J'«'.^'J 

::tt. .^^ft for our Ptos:.L'r vJ;*p1u/ 

Trie FdUC.itlOnol knrtit^jtr' tOl t ^.'fivlic:^ Ov;. ^ 

was in space sharoi by t h*^ &i 1 i n^uc* I ^^.'co^y r^.Mu . - « 
St :>f f h^^ndled overal I r^j^n^^^qemcof, the t \ty , 
di3i?xsrteJ m ol:'^':*inin9 -jn-J c ru n>:T ^.'t.iff, prc-v\^'. 
the dgcatjionai v^^o^rvxc^:. s '"hlL'>r':n »>.--r nr--<.«r- 

C'ther mi<9ic.^nt ciM)';lr*iA enr^.tlo:;- 

0emc|ri5^ti'^t xon ; cur r ic^jiluiT* vstv y4 'jv T ' ^ 
0 i** X X *i C ^i' n t v: r j t ' r n o x e . 

f VifcS'f or* »^ *>':1l:^;H -t aCTOt ^ ^ '*s5bt '.M'j hoc^ \ 0 X «: : ^ .v^- . > 
With the ?^xltnau>ii:* ptout^ixf-i ro trv- c^tL'At '-''t\ :?r-i.c ic^.^ 

to be ,thv: toma-l -if<pl iCi^nt lot Cu?:d> t roru lUe lA>>hjin',^- 

ton St.Sttc tJRRD C'rC'5^.:?«ir( . Vh- je tur^ii v-^r^ to p>> 

'ii.jtlac Jtc i* ot ull ■r^.rittt ^A^h-^io trier w^-rc Uc* i>h i n^tc^n 

t J t % V' o XO r k C d V X t t O C i. C h C 'C* Jl ^ J '-I ^" f i i ' 1 c5 T 'I > ^ T i-i . 

wtHrr»i- fM..M-Jsy9ed by the ) ^''^V'-* ? -'^^^ ^-^ ' ^ 

ret ^ .Ch<. „i\^ I i; ..O..ii.' ■ m -^^ ' t,. ^ 

itt :^f{ r J H'i c V -t 1 • A J m' 't"_ * , i o ^ r : ') • h t J ^> '-'^ut % \ n t - - » 
T'v>J*?r i '>^'f'^"« ' ^ L , I'r > _ j > i : ?' > .^c^ .^\r^jx. , , , 

ho Oi ^ -J no K :s r».^< r. J ^ ^ - n r . >r t (i^^ ' * ^ f ^ f f i 

I- I i L J 1 ;^ .1 : i y : . r '-.-.'.rM.. < c ' *. '. ^ \ ■ 
> •y\ l'"'V--nf t-h>>f, - \ 1 < , ^ r , : .vi„; - 

Sc hool o - 5: :m .i .r ? « i: ; -*te " < ^ ? i- . . 

'"""^ t , iOj « -^'r ^ * s I ■ • .'»vO . ,u - 
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